-- Logs begin at Mon 2022-05-16 16:11:59 UTC, end at Mon 2022-05-16 17:44:55 UTC. -- May 16 16:47:32.156331 dv-cinder-839987-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 16:47:32.165085 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 16:47:32 2022] *** May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: nodename: dv-cinder-839987-4-iscsi May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: machine: x86_64 May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: clock source: unix May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: pcre jit disabled May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: detected number of CPU cores: 4 May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: current working directory: / May 16 16:47:32.167089 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: detected binary path: /usr/bin/uwsgi-core May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: your processes number limit is 47680 May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: your memory page size is 4096 bytes May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: detected max file descriptor number: 2048 May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: lock engine: pthread robust mutexes May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: thunder lock: enabled May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 16:47:32.167784 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 16:47:32.211874 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: Python main interpreter initialized at 0x557be6af89c0 May 16 16:47:32.211874 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: python threads support enabled May 16 16:47:32.211874 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: your server socket listen backlog is limited to 100 connections May 16 16:47:32.211874 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: your mercy for graceful operations on workers is 90 seconds May 16 16:47:32.212190 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: mapped 403077 bytes (393 KB) for 2 cores May 16 16:47:32.212284 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: *** Operational MODE: preforking *** May 16 16:47:32.212541 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: *** uWSGI is running in multiple interpreter mode *** May 16 16:47:32.212541 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: spawned uWSGI master process (pid: 102635) May 16 16:47:32.212716 dv-cinder-839987-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 16:47:32.213785 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: spawned uWSGI worker 1 (pid: 102636, cores: 1) May 16 16:47:32.213785 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: spawned uWSGI worker 2 (pid: 102637, cores: 1) May 16 16:47:32.213785 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 16:47:33.406792 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 16:47:33.441341 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 16:47:34.163868 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:47:34.163868 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: from cryptography.utils import int_from_bytes May 16 16:47:34.164195 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:47:34.164195 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: from cryptography.utils import int_from_bytes May 16 16:47:34.176279 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:47:34.176279 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: from cryptography.utils import int_from_bytes May 16 16:47:34.176611 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:47:34.176611 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: from cryptography.utils import int_from_bytes May 16 16:47:36.772980 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 16:47:36.773535 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 16:47:36.773677 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 16:47:36.773840 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 16:47:36.774232 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 16:47:36.774322 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 16:47:36.774322 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 16:47:36.774514 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 16:47:36.774687 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.774883 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 16:47:36.775018 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.775140 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 16:47:36.775343 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.775527 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.775668 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.775858 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776007 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776185 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776305 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776506 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776634 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776837 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.776956 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.777152 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.777290 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.777477 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.777569 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.777823 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.777930 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.778158 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.778250 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-4-iscsi {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.778514 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.778741 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.778839 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.779068 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-4-iscsi {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.779166 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.779420 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.779511 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.779729 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.779824 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.780594 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.780682 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.780906 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.780997 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.781262 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.781400 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.781593 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.781865 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.781978 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.782179 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.782431 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.782538 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.782748 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.782839 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.783058 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.783160 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.783373 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.783469 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.783712 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.783806 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784031 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784135 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784344 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784446 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784655 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784753 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.784968 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.785060 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-4-iscsi {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.785293 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.785391 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.785607 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.785713 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.785990 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.786082 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-4-iscsi {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.786337 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.786435 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.786657 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.786752 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.786975 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.787079 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.787315 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.787462 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.787644 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.787778 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.787957 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.788095 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.788271 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.788421 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.788593 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.788752 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.788916 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.789068 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.789240 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.789386 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.789544 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.789712 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.789901 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.790059 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.790196 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.790384 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.790547 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.790699 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.790852 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791015 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791157 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791330 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791464 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791655 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791784 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.791967 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792103 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792275 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792410 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792563 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792703 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792842 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.792980 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.793115 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.793333 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.793469 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.793603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.793754 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.793840 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794029 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794133 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794283 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794375 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794606 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794700 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.794927 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.795022 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.795236 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.795332 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.795565 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.796231 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.796380 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.796472 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.796692 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.796783 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797013 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797097 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797330 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797415 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797652 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797772 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.797987 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.798080 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.798309 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.798392 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.798627 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.798710 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.798947 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.799046 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.799256 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.799347 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.799578 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.799672 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.799905 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800000 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800216 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800306 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800527 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800847 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.800940 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.801154 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.801239 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.801462 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.801553 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.801797 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.801896 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802123 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802207 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802434 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802518 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802742 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802826 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.802995 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.803085 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.803297 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.803384 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.803610 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.803710 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.803931 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804024 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804211 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804294 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804517 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804609 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804827 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.804911 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.805128 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.805254 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.805436 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.805527 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.805769 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.805855 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806074 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806175 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806378 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806461 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806686 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806769 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.806991 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.807084 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.807299 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.807383 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.807606 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.807703 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.807913 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808222 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808306 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808533 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808625 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808841 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.808932 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.809147 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.809229 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.809453 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.809548 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.809785 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.809883 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.810101 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.810184 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.810410 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.810494 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.810718 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.810809 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811027 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811122 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811361 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811443 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811670 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811762 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.811981 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812070 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812290 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812376 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812600 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812692 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812908 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.812999 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.813214 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.813298 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.813530 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.813616 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.813868 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.813955 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.814195 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.814287 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.814501 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.814592 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.814812 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.814901 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.815123 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.815213 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.815431 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.815520 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.815740 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.815822 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816041 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816123 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816347 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816441 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816651 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816744 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.816961 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817057 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817268 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817362 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817576 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817659 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817901 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.817999 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.818206 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.818289 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.818527 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.818612 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.818837 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.818932 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.819146 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.819237 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.819456 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.819541 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.819777 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:47:36.819873 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.820116 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.820200 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.820454 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.820539 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.820774 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.820865 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.821091 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.821182 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.821410 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.821510 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.821770 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.821859 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.822081 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.822165 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.822397 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.822481 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.822712 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.822797 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823033 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823117 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823350 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823441 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823668 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823763 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.823985 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.824093 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.824304 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.824386 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.824625 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.824709 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.824937 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.825025 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.825257 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.825342 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.825575 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.825670 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.825925 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.826026 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.826243 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.826340 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.826566 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.826732 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.826933 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.827026 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.827250 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.827342 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.827568 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.827657 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.827894 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828011 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828212 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828305 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828529 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828615 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828845 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.828930 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.829170 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.829262 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.829486 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.829575 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.829829 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.829929 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.830148 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.830233 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.830462 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.830544 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.830781 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.830872 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.831095 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.831186 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.831412 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.831502 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.831726 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.831808 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832044 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832140 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832358 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832448 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832675 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832765 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.832989 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.833073 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.833310 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.833393 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.833632 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.833728 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.833972 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834065 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834288 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834378 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834593 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834685 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834903 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.834987 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.835212 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.835296 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.835525 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.835616 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.835833 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.835929 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.836141 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.836232 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.836452 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.836545 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.836767 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.836851 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.837078 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.837169 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.837397 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.837480 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.837712 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.837825 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838046 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838142 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838358 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838442 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838669 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838753 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.838983 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839065 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839297 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839381 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839607 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839690 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839913 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.839995 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.840229 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.840313 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.840535 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.840625 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.840843 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.840926 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.841160 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.841250 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.841468 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.841552 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.841807 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.841905 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.842124 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.842215 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.842962 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.843079 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.843327 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.843422 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.843649 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.843786 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.843967 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844053 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844281 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844447 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844595 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844686 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844908 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.844991 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.845235 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.845320 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.845553 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.845685 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.845892 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.845990 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.846222 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.846314 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.846543 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.846635 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.846852 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.846936 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.847166 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.847250 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.847475 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.847559 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.847786 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.847909 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.848099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.848201 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.848413 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.848516 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.848719 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.848813 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849026 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849115 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849329 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849411 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849637 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849751 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.849967 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850051 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850277 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850371 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850590 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850683 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850898 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.850983 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.851203 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.851287 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.851509 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.851602 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.851855 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.851941 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.852165 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.852257 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.852472 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.852556 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.852782 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.852872 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.853129 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.853220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.853441 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.853526 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.853780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.853868 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.854100 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.854195 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.854414 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.854499 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.854728 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.854812 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855043 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855135 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855357 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855441 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855668 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855805 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.855979 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.856062 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.856292 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.856383 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.856604 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.856693 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.856925 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.857016 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.857237 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.857320 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.857815 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.857906 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.858693 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.858810 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859018 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859110 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859362 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859447 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859687 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859778 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.859998 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.860089 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.860320 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.860405 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.860632 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.860727 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.860950 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.861034 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.861265 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.861356 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.861579 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.861663 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.861917 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862003 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862233 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862316 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862553 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862638 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862864 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.862947 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.863176 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.863258 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.863486 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.863570 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.863806 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.863896 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.864120 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.864204 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.864439 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.864529 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.864744 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.864835 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.865061 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.865145 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.865372 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.865498 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.865693 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.865813 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866026 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866119 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866337 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866419 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866662 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866753 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.866974 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867067 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867284 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867376 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867599 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867682 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867904 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.867994 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.868209 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.868292 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.868518 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.868609 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.868834 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.868927 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.869143 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.869225 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.869452 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.869541 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.869776 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.869864 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.870096 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.870190 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.870408 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.870492 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.870715 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.870807 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871023 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871106 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871336 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871418 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871645 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.871953 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872050 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872261 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872352 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872576 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872660 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872882 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.872964 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.873189 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.873280 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.873513 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.873596 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.873873 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.873967 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.874183 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.874342 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.874488 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.874571 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.874793 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.874876 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.875113 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.875208 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.875422 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.875505 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.875726 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.875808 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876031 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876127 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876354 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876666 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876751 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.876972 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.877057 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.877282 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.877374 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.877591 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.877687 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.877926 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878013 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878264 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878359 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878550 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878634 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878859 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.878943 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.879170 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.879263 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.879482 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.879566 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.879791 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.879875 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.880105 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.880189 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.880413 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.880510 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.880725 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.880808 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881037 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881120 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881342 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881434 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881653 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881764 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.881997 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.882094 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.882346 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.882560 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.882645 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.882896 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.882979 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.883216 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.883298 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.883536 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.883809 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.883900 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.884146 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.884234 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.884466 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.884551 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.884790 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.884873 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.885113 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.885196 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.885438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.885532 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.885796 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.885886 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.886081 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.886178 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.886390 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.886493 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.886703 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.886799 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887012 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887096 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887319 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887404 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887628 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887713 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.887939 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888022 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888246 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888330 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888552 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888637 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888856 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.888948 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.889164 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.889256 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.889505 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.889591 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.889850 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.889949 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.890167 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.890260 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.890475 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.890559 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.890796 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.890880 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.891105 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.891202 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.891411 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.891494 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.891720 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.891810 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892025 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892116 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892347 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892430 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892656 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892749 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.892965 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.893057 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.893273 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.893358 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.893618 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.893702 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.893951 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894055 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894264 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894354 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894593 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894677 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894903 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.894995 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.895212 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.895304 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.895521 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.895605 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.895835 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.895927 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.896147 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.896232 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.896453 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.896538 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.896760 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.896850 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.897070 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.897163 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.897380 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.897465 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.897686 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.897791 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898018 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898102 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898329 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898487 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898634 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898725 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.898947 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899029 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899255 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899346 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899561 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899645 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899865 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.899964 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.900180 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.900273 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.900487 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.900576 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.900792 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.900874 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.901098 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.901192 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.901401 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.901485 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.901716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.901865 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902044 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902131 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902351 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902434 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902656 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902739 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.902966 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903056 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903276 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903361 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903581 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903665 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903887 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.903971 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.904202 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.904287 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.904509 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.904591 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.904813 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.905411 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.905653 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.905761 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.905987 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.906081 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.906295 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.906380 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.906604 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.906686 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.906919 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907012 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907228 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907359 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907535 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907621 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907845 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.907936 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.908150 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.908233 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.908459 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.908543 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.908765 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.908857 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.909076 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.909159 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.909379 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.909461 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.909686 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.909790 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910017 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910111 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910321 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910412 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910626 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910711 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.910934 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911018 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911239 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911323 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911545 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911638 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911851 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.911936 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.912156 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.912241 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.912474 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.912558 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.912783 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.912867 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.913090 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.913183 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.913398 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.913482 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.913779 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.913867 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.914070 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.914172 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.914386 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.914469 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.914705 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.914794 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915020 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915117 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915327 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915411 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915645 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915729 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.915955 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916051 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916268 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916390 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916574 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916658 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916880 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.916973 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.917195 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.917278 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.917506 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.917640 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.917835 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.917923 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.918148 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.918232 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.918473 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.918567 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.918791 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.918875 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.919098 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.919181 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.919409 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.919494 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.919721 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.919806 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.920033 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.920125 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.920344 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.920429 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.921214 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.921312 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.921530 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.921615 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.921869 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.921972 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.922185 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.922271 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.922500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.922583 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.922811 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.922904 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.923120 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.923207 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.923433 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.923518 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.923745 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.923845 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924051 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924136 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924361 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924490 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924676 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924773 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.924982 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.925065 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.925293 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.925375 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.925596 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.925686 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.925944 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926031 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926257 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926348 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926574 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926666 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926883 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.926974 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.927207 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.927291 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.927520 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.927605 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.927872 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.927955 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.928185 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.928271 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.928502 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.928597 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.928818 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.928903 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.929125 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.929218 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.929477 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.929567 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.929828 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.929929 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.930153 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.930251 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.930465 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.930551 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.930779 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.930887 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.931085 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.931205 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.931399 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.931520 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.931726 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.931843 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932036 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932154 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932344 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932464 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932651 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932781 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.932976 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.933110 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.933282 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.933418 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.933605 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.933726 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.934053 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.934139 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.934368 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.934460 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.934677 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.934796 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.935004 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.935089 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.935391 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.935474 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.935703 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.935787 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.936021 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.936105 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.936404 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.936492 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.936733 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.936826 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.937041 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.937125 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.937357 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.937442 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.937668 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.937838 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938025 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938124 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938351 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938437 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938665 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938756 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.938982 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.939148 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.939290 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.939376 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.939617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.939703 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.939932 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940024 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940251 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940342 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940560 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940643 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940890 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.940983 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.941218 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.941303 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.941539 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.941630 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.941896 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.941998 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.942250 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.942334 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.942562 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.942647 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.942873 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.942958 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.943188 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.943273 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.943497 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.943581 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.943804 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.943889 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.944130 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.944216 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.944441 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.944525 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.944755 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.944838 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.945064 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.945156 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.945374 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.945475 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.945683 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.945791 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946017 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946102 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946332 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946427 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946646 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946739 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.946959 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.947044 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.947271 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.947365 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.947595 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.947679 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.947904 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948004 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948225 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948323 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948541 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948625 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948856 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.948938 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.949166 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.949251 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.949474 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.949558 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.949803 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.949893 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.950132 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.950218 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.950444 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.950529 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.950753 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.950838 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.951062 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.951147 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.951414 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.951498 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.951730 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.951845 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.952080 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.952165 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.952408 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.952498 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.952727 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.952820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.953044 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.953128 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.953371 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.953454 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.953684 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.953799 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954033 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954119 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954349 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954433 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954667 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954808 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.954975 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955061 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955283 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955367 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955593 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955679 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955900 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.955984 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.956206 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.956289 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.956512 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.956597 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.956822 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.956906 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.957130 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.957214 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.957435 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.957519 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.957784 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.957875 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.958077 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.958160 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.958385 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.958470 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.958692 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.958788 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959012 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959109 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959320 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959405 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959627 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959719 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.959935 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960037 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960272 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960356 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960579 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960663 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960906 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.960999 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.961228 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.961311 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.961546 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.961630 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.961888 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.961994 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.962208 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.962294 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.962530 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.962621 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.962846 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.962944 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.963164 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.963248 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.963478 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.963562 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.963790 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.963876 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.964105 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.964198 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.964421 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.964512 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.964738 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.964829 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.965052 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.965253 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.965371 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.965584 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.965685 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.965929 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.966016 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.966247 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.966527 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.966612 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.966863 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.966948 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.967178 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.967269 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968002 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968106 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968316 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968401 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968630 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968720 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.968941 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.969107 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.969255 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.969347 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.969569 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.969654 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.969906 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970015 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970223 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970308 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970552 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970637 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970870 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.970955 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.971191 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.971276 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.971508 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.971599 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.971832 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.971917 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.972156 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.972241 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.972465 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.972558 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.972781 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.972866 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.973100 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.973192 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.973419 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.973517 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.973732 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.973847 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.974077 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.974163 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.974393 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.974479 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.974709 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.974794 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975021 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975105 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975333 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975418 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975648 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975739 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.975963 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.976047 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.976273 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.976359 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.976585 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.976678 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.976899 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977042 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977215 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977302 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977531 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977615 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977872 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.977972 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.978260 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.978392 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.978523 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.978711 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.978841 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.979048 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.979160 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.979378 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.979678 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.979762 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.979994 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.980088 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.980317 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.980401 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.980646 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.980729 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.980954 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.981039 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.981262 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.981347 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.981576 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.981661 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.981915 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.982007 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.982235 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.982319 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.982806 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.982896 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.983665 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.983760 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.983977 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.984072 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.984303 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.984396 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.984618 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.984703 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.984930 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.985154 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.985241 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.985501 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.985586 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.985843 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.985943 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.986173 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.986402 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.986501 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.986749 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.986841 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.987069 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.987154 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.987401 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.987498 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.987717 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.987801 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988026 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988110 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988340 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988431 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988651 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988734 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.988960 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.989045 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.989269 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.989360 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.989580 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.989671 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.989915 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990000 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990221 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990307 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990529 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990612 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990834 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.990918 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.991145 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.991229 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.991454 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.991538 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.991760 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.991852 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992069 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992154 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992384 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992468 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992691 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992787 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.992997 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.993082 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.993302 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.993386 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.993606 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.993698 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.993941 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994025 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994251 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994345 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994561 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994654 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994866 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.994950 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.995181 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.995265 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.995487 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.995580 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.995798 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.995887 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.996107 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.996198 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.996422 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.996511 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.996730 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.996816 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.997042 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.997126 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.997362 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.997448 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.997675 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.997779 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998026 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998110 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998336 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998466 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998661 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998749 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.998984 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.999068 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.999313 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.999400 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.999630 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.999843 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:36.999929 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.000183 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.000277 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.000510 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.000596 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.000848 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.001111 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.001205 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.001450 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.001535 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.001793 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.001882 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.002108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.002205 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.002435 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.002521 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.002748 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.002833 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003056 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003141 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003364 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003448 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003676 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003761 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.003989 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.004082 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.004300 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.004384 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.004610 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.004695 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.004919 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005005 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005231 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005314 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005538 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005622 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005877 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.005974 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.006191 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.006275 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.006499 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.006590 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.006812 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.006896 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.007124 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.007211 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.007447 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.007549 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.007762 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.007846 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.008077 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.008163 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.008389 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.008482 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.008701 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.008787 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009013 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009145 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009325 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009412 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009637 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009722 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.009976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010062 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010377 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010598 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010681 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010914 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.010997 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.011246 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.011333 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.011566 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.011650 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.011874 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.011968 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.012234 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.012319 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.012559 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.012645 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.012886 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.012981 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.013210 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.013295 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.013525 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.013615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.013860 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.013960 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.014192 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.014781 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015026 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015110 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015354 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015441 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015667 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015759 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.015992 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.016076 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.016302 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.016394 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.016608 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.016693 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.016920 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017006 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017242 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017328 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017548 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017632 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017877 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.017976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.018187 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.018273 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.018503 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.018588 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.018813 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.018906 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.019117 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.019256 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.019423 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.019507 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.019728 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.019821 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020033 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020116 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020336 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020421 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020639 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.020943 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021026 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021248 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021332 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021553 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021638 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021883 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.021972 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.022191 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.022276 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.022496 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.022589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.022804 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.022890 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.023149 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.023239 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.023413 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.023498 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.023718 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.023801 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024024 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024110 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024331 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024423 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024639 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024731 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.024945 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.025043 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.025279 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.025364 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.025606 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.025730 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.025945 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026045 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026271 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026355 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026584 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026677 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026900 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.026993 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.027211 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.027339 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.027536 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.027622 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.027846 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.027943 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.028166 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.028250 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.028479 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.028563 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.028794 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.028881 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.029108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.029195 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.029420 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.029506 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.029761 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.029851 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.030615 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.030709 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.030931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031017 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031246 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031334 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031579 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031670 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031903 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.031996 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.032217 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.032301 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.032531 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.032622 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.032863 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.032959 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.033178 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.033269 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.033493 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.033841 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.034159 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.034474 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.034796 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.035116 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.035408 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.035495 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.035759 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.035890 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.036073 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.036158 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.036404 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.036490 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.036735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.036812 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.037084 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.037160 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.037401 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.037476 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.037729 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.037862 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.038085 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.038161 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.038416 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.038508 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.038766 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.039073 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.039320 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 16:47:37.041009 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.041376 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.041720 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.042124 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.042479 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.042851 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.043189 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.043551 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.043898 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.044232 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.044561 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.044883 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:47:37.045140 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 16:47:37.062264 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_db.sqlalchemy.engines [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.067766 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_db.sqlalchemy.engines [None req-547f2994-8290-4b74-b802-1330d3622546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.125612 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.context [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316a0b18-3be7-4e60-8d08-0592b3fea63b(cell1) {{(pid=102637) load_cells /opt/stack/nova/nova/context.py:464}} May 16 16:47:37.129962 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:47:37.130807 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.context [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316a0b18-3be7-4e60-8d08-0592b3fea63b(cell1) {{(pid=102636) load_cells /opt/stack/nova/nova/context.py:464}} May 16 16:47:37.131532 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:47:37.132316 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:47:37.134258 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:47:37.135108 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_concurrency.lockutils [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:47:37.136680 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_concurrency.lockutils [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:47:37.137475 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_concurrency.lockutils [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:47:37.139983 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_concurrency.lockutils [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:47:37.146018 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_db.sqlalchemy.engines [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.149058 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_db.sqlalchemy.engines [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.154236 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_db.sqlalchemy.engines [None req-547f2994-8290-4b74-b802-1330d3622546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.158130 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_db.sqlalchemy.engines [None req-547f2994-8290-4b74-b802-1330d3622546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.308563 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_db.sqlalchemy.engines [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.314546 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG oslo_db.sqlalchemy.engines [None req-547f2994-8290-4b74-b802-1330d3622546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:47:37.651270 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: WARNING keystonemiddleware.auth_token [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:47:37.651819 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: WARNING keystonemiddleware.auth_token [None req-547f2994-8290-4b74-b802-1330d3622546 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:47:37.658727 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: WARNING keystonemiddleware.auth_token [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:47:37.659104 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: WARNING keystonemiddleware.auth_token [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:47:38.006223 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: WARNING keystonemiddleware.auth_token [None req-547f2994-8290-4b74-b802-1330d3622546 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:47:38.008267 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: WARNING keystonemiddleware.auth_token [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:47:38.012204 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: WARNING keystonemiddleware.auth_token [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:47:38.014455 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: WARNING keystonemiddleware.auth_token [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:47:38.018324 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557be6af89c0 pid: 102636 (default app) May 16 16:47:38.020397 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-547f2994-8290-4b74-b802-1330d3622546 None None] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:47:38.020555 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557be6af89c0 pid: 102637 (default app) May 16 16:47:38.021564 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-547f2994-8290-4b74-b802-1330d3622546 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 May 16 16:47:38.022004 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Mon May 16 16:47:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:48:55.160269 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:48:55.161478 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 May 16 16:48:55.162043 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:48:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:48:55.585500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-39f2c105-c8e7-4704-a135-08e72cb11eea admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:48:55.615396 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-39f2c105-c8e7-4704-a135-08e72cb11eea admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447397 May 16 16:48:55.616045 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 16 16:48:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:48:57.882661 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:48:57.883652 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-11a6ec61-6842-40f8-8563-9ce0b91668ca None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 16 16:48:57.884200 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 2/4] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:48:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:48:57.955555 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-b4ca405b-6443-4091-b09f-91d4515559a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:48:57.974352 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:48:57.974352 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: warnings.warn(msg) May 16 16:48:58.003907 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-b4ca405b-6443-4091-b09f-91d4515559a8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.113601 May 16 16:48:58.004715 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 3/5] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:48:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:48:58.220022 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-c8f946fc-3160-4a8c-a4d3-a0749db6c33f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:48:58.223299 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:48:58.223299 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: warnings.warn(msg) May 16 16:48:58.278545 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-c8f946fc-3160-4a8c-a4d3-a0749db6c33f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265225 May 16 16:48:58.279326 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 3/6] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 16 16:48:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:49:00.599366 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-b4ca405b-6443-4091-b09f-91d4515559a8 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:00.601046 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-b4ca405b-6443-4091-b09f-91d4515559a8 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 May 16 16:49:00.603690 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 4/7] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:00.713931 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-5d993c23-cc08-4320-a8e7-e7d9c6d3407b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M"}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:00.731751 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:49:00.731751 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: warnings.warn(msg) May 16 16:49:00.750003 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-5d993c23-cc08-4320-a8e7-e7d9c6d3407b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141763 May 16 16:49:00.750556 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 4/8] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:00.762556 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-143b2458-4305-442a-96fd-68ab85ec7964 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:00.764029 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:49:00.764029 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: warnings.warn(msg) May 16 16:49:00.793631 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-143b2458-4305-442a-96fd-68ab85ec7964 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035305 May 16 16:49:00.809899 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 5/9] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 16 16:49:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:03.063780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-5d993c23-cc08-4320-a8e7-e7d9c6d3407b admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:03.065031 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-5d993c23-cc08-4320-a8e7-e7d9c6d3407b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 May 16 16:49:03.065696 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:03.129712 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-ac363f07-bf1e-457b-8850-49e3b2d09ac1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:03.149319 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-ac363f07-bf1e-457b-8850-49e3b2d09ac1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077799 May 16 16:49:03.150259 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 6/11] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:03.161633 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-2346c5ac-6cf4-40d9-bf22-ff542ff2744a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:03.185261 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-2346c5ac-6cf4-40d9-bf22-ff542ff2744a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027212 May 16 16:49:03.193779 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 6/12] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 16 16:49:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:49:05.447338 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-ac363f07-bf1e-457b-8850-49e3b2d09ac1 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:05.448481 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-ac363f07-bf1e-457b-8850-49e3b2d09ac1 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 May 16 16:49:05.449164 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 7/13] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:05.509934 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-5206f808-cde2-4a7d-8f39-2fdcc76b2b5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:05.530993 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-5206f808-cde2-4a7d-8f39-2fdcc76b2b5f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075636 May 16 16:49:05.531584 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 7/14] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:05.543135 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-7d472650-52cc-458a-b644-cb23e19d0c99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:05.565198 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-7d472650-52cc-458a-b644-cb23e19d0c99 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025669 May 16 16:49:05.565789 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 8/15] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 16 16:49:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:07.828440 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-5206f808-cde2-4a7d-8f39-2fdcc76b2b5f admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:07.829445 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-5206f808-cde2-4a7d-8f39-2fdcc76b2b5f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 16 16:49:07.830055 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 8/16] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:07.886044 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-c61b9d01-796d-4a23-a3cd-dc03b9f82a8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:07.907918 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-c61b9d01-796d-4a23-a3cd-dc03b9f82a8b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072196 May 16 16:49:07.908950 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 9/17] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:07.920600 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-ae82f376-394e-4057-8778-2ee49c39b401 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:07.945811 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-ae82f376-394e-4057-8778-2ee49c39b401 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029269 May 16 16:49:07.947221 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 9/18] 10.222.0.70 () {64 vars in 1335 bytes} [Mon May 16 16:49:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:10.202849 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-c61b9d01-796d-4a23-a3cd-dc03b9f82a8b admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:10.204054 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-c61b9d01-796d-4a23-a3cd-dc03b9f82a8b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 May 16 16:49:10.204470 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 10/19] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:10.274346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-da49e814-7423-4167-81d0-7fd8e0c09ed0 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:10.298681 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-da49e814-7423-4167-81d0-7fd8e0c09ed0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087228 May 16 16:49:10.299235 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 16 16:49:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:49:12.798946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-c61b9d01-796d-4a23-a3cd-dc03b9f82a8b admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:12.800050 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-c61b9d01-796d-4a23-a3cd-dc03b9f82a8b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 16 16:49:12.800420 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 11/21] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:12.861711 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-6684f4bd-155c-4aa9-adf5-b390e3a3b34c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 1, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:12.882388 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-6684f4bd-155c-4aa9-adf5-b390e3a3b34c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075563 May 16 16:49:12.883150 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 11/22] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:12.896649 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-fbab7f19-d086-4551-b5bc-ace7e62f2954 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:12.920590 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-fbab7f19-d086-4551-b5bc-ace7e62f2954 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027599 May 16 16:49:12.921169 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 12/23] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 16 16:49:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:15.233994 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-6684f4bd-155c-4aa9-adf5-b390e3a3b34c admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:15.235024 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-6684f4bd-155c-4aa9-adf5-b390e3a3b34c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 May 16 16:49:15.235427 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:15.298207 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-b2895219-0fc9-4ae5-b561-7a1cba0d7e8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:15.318370 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-b2895219-0fc9-4ae5-b561-7a1cba0d7e8d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076987 May 16 16:49:15.319000 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:15.334923 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-b39dcbd2-38e6-4712-ba42-198ff36324a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:15.362088 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-b39dcbd2-38e6-4712-ba42-198ff36324a5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031779 May 16 16:49:15.363198 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 13/26] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 16 16:49:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:49:17.695328 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-b2895219-0fc9-4ae5-b561-7a1cba0d7e8d admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:17.696335 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-b2895219-0fc9-4ae5-b561-7a1cba0d7e8d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 16 16:49:17.696761 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:17.753691 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-d2f1fcf0-c47c-479a-bcba-097dc77bdc91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:17.771663 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-d2f1fcf0-c47c-479a-bcba-097dc77bdc91 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068486 May 16 16:49:17.772310 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 14/28] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:17.784660 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-14be5796-55a6-4f53-b0c5-9b6ae72ba56e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:17.805392 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-14be5796-55a6-4f53-b0c5-9b6ae72ba56e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024391 May 16 16:49:17.806023 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 15/29] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 16 16:49:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:20.067892 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-d2f1fcf0-c47c-479a-bcba-097dc77bdc91 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:20.068974 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-d2f1fcf0-c47c-479a-bcba-097dc77bdc91 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 16 16:49:20.069372 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:20.125399 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-2a5cdc29-b0b0-4e56-8c9e-44d50425d415 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "disk": 80}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:20.144283 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-2a5cdc29-b0b0-4e56-8c9e-44d50425d415 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068498 May 16 16:49:20.144822 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 16/31] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:20.156522 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-f73238c7-9322-4710-a8ea-1bc43c920ba9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:20.177476 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-f73238c7-9322-4710-a8ea-1bc43c920ba9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024552 May 16 16:49:20.178258 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 16/32] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 16 16:49:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:22.481754 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-2a5cdc29-b0b0-4e56-8c9e-44d50425d415 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:22.482853 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-2a5cdc29-b0b0-4e56-8c9e-44d50425d415 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 May 16 16:49:22.483742 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 17/33] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:22.546208 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-f2f5a296-788c-45b2-b050-fd3f5f956b00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5", "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:22.565345 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-f2f5a296-788c-45b2-b050-fd3f5f956b00 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076246 May 16 16:49:22.566083 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 17/34] 10.222.0.70 () {64 vars in 1282 bytes} [Mon May 16 16:49:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:22.577567 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-d6cd1eed-d8a4-4af5-975a-acef99fe39e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:22.605940 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-d6cd1eed-d8a4-4af5-975a-acef99fe39e3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031416 May 16 16:49:22.606764 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 18/35] 10.222.0.70 () {64 vars in 1332 bytes} [Mon May 16 16:49:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:49:46.873429 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-f2f5a296-788c-45b2-b050-fd3f5f956b00 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:46.874455 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-f2f5a296-788c-45b2-b050-fd3f5f956b00 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 16 16:49:46.874853 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:49:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:46.930149 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-775a7095-33ca-4810-885f-17450a8b4c4b admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:46.947016 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-775a7095-33ca-4810-885f-17450a8b4c4b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066242 May 16 16:49:46.947540 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 16 16:49:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:49:47.940391 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-f2f5a296-788c-45b2-b050-fd3f5f956b00 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:47.941391 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-f2f5a296-788c-45b2-b050-fd3f5f956b00 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 16 16:49:47.941814 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:48.146098 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-8b3cb7e7-8ebe-4c55-83a4-b4fc7bf82db0 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:48.151684 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.wsgi [None req-8b3cb7e7-8ebe-4c55-83a4-b4fc7bf82db0 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-8b3cb7e7-8ebe-4c55-83a4-b4fc7bf82db0 admin admin] Request method failure captured: May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Accept: application/json May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Accept-Encoding: gzip, deflate May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Connection: keep-alive May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Content-Length: 0 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Host: 10.222.0.70 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Openstack-Api-Version: compute 2.90 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Openstack-System-Scope: None May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: User-Agent: python-novaclient May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Auth-Token: gAAAAABigoCrKUkoRlyRAQc_g4bPaIkn5VUNvmCxSn3pq2_6duUeLTXNU4zuj38ltocR_XYm4OVErI3E6Mw8sX3Pbz7l2jc9c9L-VOP2-A758kxJBkK96gw31KDhQ3PL85LYANvPGdh0-oSZnk2_ENnIFZnUstilIHr22Zm45ZoRNvbi85wab24 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Domain-Id: None May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Domain-Name: None May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Identity-Status: Confirmed May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Is-Admin-Project: True May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Openstack-Nova-Api-Version: 2.90 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Domain-Id: default May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Domain-Name: Default May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Name: admin May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Role: reader,admin,member May 16 16:49:48.154931 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Roles: reader,admin,member May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eca989f1268f4da189675a074fd55f83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eca989f1268f4da189675a074fd55f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant: admin May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant-Name: admin May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User: admin May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Domain-Id: default May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Domain-Name: Default May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Id: f37f6f0cc485427c90ba2081965287a3 May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Name: admin May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: method: > May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: exception: Flavor 42 could not be found. May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: action_args: {'id': '42'} May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:49:48.156603 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:48.157500 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:48.158946 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-8b3cb7e7-8ebe-4c55-83a4-b4fc7bf82db0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:49:48.160272 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-8b3cb7e7-8ebe-4c55-83a4-b4fc7bf82db0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059929 May 16 16:49:48.160272 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 16 16:49:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 16:49:48.165880 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-dcffcbcc-58d5-4132-ad51-bf3855bdb207 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:48.188675 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-dcffcbcc-58d5-4132-ad51-bf3855bdb207 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026240 May 16 16:49:48.190404 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 16 16:49:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:49:48.202132 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-338197aa-bef9-40ef-bdd9-7710b3e4eae3 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:48.223702 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-338197aa-bef9-40ef-bdd9-7710b3e4eae3 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025177 May 16 16:49:48.224232 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 16 16:49:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:49:48.233615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-35549b00-ae08-4279-aaa2-801c770964fc admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:48.239092 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.wsgi [None req-35549b00-ae08-4279-aaa2-801c770964fc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-35549b00-ae08-4279-aaa2-801c770964fc admin admin] Request method failure captured: May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Accept: application/json May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Accept-Encoding: gzip, deflate May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Connection: keep-alive May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Content-Length: 0 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Host: 10.222.0.70 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Openstack-Api-Version: compute 2.90 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Openstack-System-Scope: None May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: User-Agent: python-novaclient May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Auth-Token: gAAAAABigoCrKUkoRlyRAQc_g4bPaIkn5VUNvmCxSn3pq2_6duUeLTXNU4zuj38ltocR_XYm4OVErI3E6Mw8sX3Pbz7l2jc9c9L-VOP2-A758kxJBkK96gw31KDhQ3PL85LYANvPGdh0-oSZnk2_ENnIFZnUstilIHr22Zm45ZoRNvbi85wab24 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Domain-Id: None May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Domain-Name: None May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Identity-Status: Confirmed May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Is-Admin-Project: True May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Openstack-Nova-Api-Version: 2.90 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Domain-Id: default May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Domain-Name: Default May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Name: admin May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Role: reader,admin,member May 16 16:49:48.242346 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Roles: reader,admin,member May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eca989f1268f4da189675a074fd55f83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eca989f1268f4da189675a074fd55f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant: admin May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant-Name: admin May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User: admin May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Domain-Id: default May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Domain-Name: Default May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Id: f37f6f0cc485427c90ba2081965287a3 May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Name: admin May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: method: > May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: exception: Flavor 42 could not be found. May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: action_args: {'id': '42'} May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:49:48.243836 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:48.244780 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:48.246671 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-35549b00-ae08-4279-aaa2-801c770964fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:49:48.247938 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-35549b00-ae08-4279-aaa2-801c770964fc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013857 May 16 16:49:48.247938 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 16 16:49:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 16:49:49.126412 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-338197aa-bef9-40ef-bdd9-7710b3e4eae3 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:49.127409 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-338197aa-bef9-40ef-bdd9-7710b3e4eae3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 16 16:49:49.127799 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 22/43] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:49.315317 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-0fbc72d4-33bc-4460-999f-9ae0b78ba607 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:49.320549 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.wsgi [None req-0fbc72d4-33bc-4460-999f-9ae0b78ba607 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-0fbc72d4-33bc-4460-999f-9ae0b78ba607 admin admin] Request method failure captured: May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Accept: application/json May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Accept-Encoding: gzip, deflate May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Connection: keep-alive May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Content-Length: 0 May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Host: 10.222.0.70 May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Openstack-Api-Version: compute 2.90 May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Openstack-System-Scope: None May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: User-Agent: python-novaclient May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Auth-Token: gAAAAABigoCtoBoSF8BARRxCgmEkrFvzTJPk5xPW7Fd4C3bolCmDktDzo2Y0Ng0k4o3EbR8e9GvAZ_ZS5EULskx1IZhCUbeGSaM3pKQnjoEVqEjTcCT337ANO2Ioc1lpojVNvkIjhtSVqGCV4teXNhMypXBw_3XvYyRT_z6tfv0WsSKtDx6nlgo May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Domain-Id: None May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Domain-Name: None May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Identity-Status: Confirmed May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Is-Admin-Project: True May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Openstack-Nova-Api-Version: 2.90 May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Domain-Id: default May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Domain-Name: Default May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Name: admin May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Role: reader,admin,member May 16 16:49:49.322099 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Roles: reader,admin,member May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eca989f1268f4da189675a074fd55f83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eca989f1268f4da189675a074fd55f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant: admin May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant-Name: admin May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User: admin May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Domain-Id: default May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Domain-Name: Default May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Id: f37f6f0cc485427c90ba2081965287a3 May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Name: admin May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: method: > May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: exception: Flavor 84 could not be found. May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: action_args: {'id': '84'} May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:49:49.323735 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:49.324615 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:49.327009 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-0fbc72d4-33bc-4460-999f-9ae0b78ba607 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:49:49.328028 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-0fbc72d4-33bc-4460-999f-9ae0b78ba607 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061812 May 16 16:49:49.328028 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 16 16:49:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 16 16:49:49.334548 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-9143d40e-26bc-4ecb-b4ad-a72469a34b05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:49.348854 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-9143d40e-26bc-4ecb-b4ad-a72469a34b05 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017755 May 16 16:49:49.349613 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 16 16:49:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:49:49.360094 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-b82fe44e-f65a-47bd-acd6-4059afe8dae0 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:49.374504 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-b82fe44e-f65a-47bd-acd6-4059afe8dae0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018304 May 16 16:49:49.375274 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 16 16:49:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:49:49.384430 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-fd0e8dae-8666-4bed-ab8c-03533ac2a567 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:49.389943 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.wsgi [None req-fd0e8dae-8666-4bed-ab8c-03533ac2a567 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-fd0e8dae-8666-4bed-ab8c-03533ac2a567 admin admin] Request method failure captured: May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Accept: application/json May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Accept-Encoding: gzip, deflate May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Connection: keep-alive May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Content-Length: 0 May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Host: 10.222.0.70 May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Openstack-Api-Version: compute 2.90 May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Openstack-System-Scope: None May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: User-Agent: python-novaclient May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Auth-Token: gAAAAABigoCtoBoSF8BARRxCgmEkrFvzTJPk5xPW7Fd4C3bolCmDktDzo2Y0Ng0k4o3EbR8e9GvAZ_ZS5EULskx1IZhCUbeGSaM3pKQnjoEVqEjTcCT337ANO2Ioc1lpojVNvkIjhtSVqGCV4teXNhMypXBw_3XvYyRT_z6tfv0WsSKtDx6nlgo May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Domain-Id: None May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Domain-Name: None May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Identity-Status: Confirmed May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Is-Admin-Project: True May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Openstack-Nova-Api-Version: 2.90 May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Domain-Id: default May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Domain-Name: Default May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Name: admin May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Role: reader,admin,member May 16 16:49:49.391438 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Roles: reader,admin,member May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eca989f1268f4da189675a074fd55f83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eca989f1268f4da189675a074fd55f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant: admin May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant-Name: admin May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User: admin May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Domain-Id: default May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Domain-Name: Default May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Id: f37f6f0cc485427c90ba2081965287a3 May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Name: admin May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: method: > May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: exception: Flavor 84 could not be found. May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: action_args: {'id': '84'} May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:49:49.392818 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:49.393589 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:49.394716 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-fd0e8dae-8666-4bed-ab8c-03533ac2a567 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:49:49.395952 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-fd0e8dae-8666-4bed-ab8c-03533ac2a567 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011888 May 16 16:49:49.395952 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 24/47] 10.222.0.70 () {60 vars in 1190 bytes} [Mon May 16 16:49:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 16:49:50.279227 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-b82fe44e-f65a-47bd-acd6-4059afe8dae0 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:50.280231 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-b82fe44e-f65a-47bd-acd6-4059afe8dae0 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 16 16:49:50.280626 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 24/48] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:50.467123 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-103a2036-d67b-49a0-91b0-ee256eebfc43 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:50.472757 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.wsgi [None req-103a2036-d67b-49a0-91b0-ee256eebfc43 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-103a2036-d67b-49a0-91b0-ee256eebfc43 admin admin] Request method failure captured: May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Accept: application/json May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Accept-Encoding: gzip, deflate May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Connection: keep-alive May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Content-Length: 0 May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Host: 10.222.0.70 May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Openstack-Api-Version: compute 2.90 May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Openstack-System-Scope: None May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: User-Agent: python-novaclient May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Auth-Token: gAAAAABigoCuFDQ2uTXv0VtNGaTWdpO6xZExupR05gMqb1ZUkz4orJkTvL6h81QDGmuYM5AxfszqApgYwWmKqnxIJdPLyv31CpgTkxXjBOvTeIvEKsMvkwNX-1a6h4an-DyY8kdzbsM88Cvy9WjLZ1nRw_KFcPdMNFbWy5AZgpD6VIlYeo0y9wc May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Domain-Id: None May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Domain-Name: None May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Identity-Status: Confirmed May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Is-Admin-Project: True May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Openstack-Nova-Api-Version: 2.90 May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Domain-Id: default May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Domain-Name: Default May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Project-Name: admin May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Role: reader,admin,member May 16 16:49:50.474290 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Roles: reader,admin,member May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eca989f1268f4da189675a074fd55f83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eca989f1268f4da189675a074fd55f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant: admin May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-Tenant-Name: admin May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User: admin May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Domain-Id: default May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Domain-Name: Default May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Id: f37f6f0cc485427c90ba2081965287a3 May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: X-User-Name: admin May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: method: > May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: exception: Flavor 451 could not be found. May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: action_args: {'id': '451'} May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:49:50.475820 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:50.476800 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: ERROR nova.api.openstack.wsgi May 16 16:49:50.477976 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-103a2036-d67b-49a0-91b0-ee256eebfc43 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:49:50.479008 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-103a2036-d67b-49a0-91b0-ee256eebfc43 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061572 May 16 16:49:50.479008 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 16 16:49:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 16:49:50.485795 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-7370db6d-e817-4455-ac72-c68c959d562c admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:50.499607 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-7370db6d-e817-4455-ac72-c68c959d562c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017317 May 16 16:49:50.500066 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 25/50] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 16 16:49:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:49:50.508995 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:50.522823 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017195 May 16 16:49:50.523339 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 26/51] 10.222.0.70 () {60 vars in 1210 bytes} [Mon May 16 16:49:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:49:50.532044 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-2d420f37-890c-4c2c-bb4d-667a685237e4 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:50.537109 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.wsgi [None req-2d420f37-890c-4c2c-bb4d-667a685237e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-2d420f37-890c-4c2c-bb4d-667a685237e4 admin admin] Request method failure captured: May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Accept: application/json May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Accept-Encoding: gzip, deflate May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Connection: keep-alive May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Content-Length: 0 May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Host: 10.222.0.70 May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Openstack-Api-Version: compute 2.90 May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Openstack-System-Scope: None May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: User-Agent: python-novaclient May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Auth-Token: gAAAAABigoCuFDQ2uTXv0VtNGaTWdpO6xZExupR05gMqb1ZUkz4orJkTvL6h81QDGmuYM5AxfszqApgYwWmKqnxIJdPLyv31CpgTkxXjBOvTeIvEKsMvkwNX-1a6h4an-DyY8kdzbsM88Cvy9WjLZ1nRw_KFcPdMNFbWy5AZgpD6VIlYeo0y9wc May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Domain-Id: None May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Domain-Name: None May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Identity-Status: Confirmed May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Is-Admin-Project: True May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Openstack-Nova-Api-Version: 2.90 May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Domain-Id: default May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Domain-Name: Default May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Project-Name: admin May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Role: reader,admin,member May 16 16:49:50.538617 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Roles: reader,admin,member May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eca989f1268f4da189675a074fd55f83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eca989f1268f4da189675a074fd55f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eca989f1268f4da189675a074fd55f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant: admin May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant-Id: eca989f1268f4da189675a074fd55f83 May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-Tenant-Name: admin May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User: admin May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Domain-Id: default May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Domain-Name: Default May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Id: f37f6f0cc485427c90ba2081965287a3 May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: X-User-Name: admin May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: method: > May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: exception: Flavor 451 could not be found. May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: action_args: {'id': '451'} May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:49:50.540163 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:50.541220 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: ERROR nova.api.openstack.wsgi May 16 16:49:50.543108 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-2d420f37-890c-4c2c-bb4d-667a685237e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:49:50.544336 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-2d420f37-890c-4c2c-bb4d-667a685237e4 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011331 May 16 16:49:50.544336 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 26/52] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 16 16:49:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 16:49:51.414344 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:51.415342 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 16 16:49:51.415738 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 27/53] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:51.600911 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-6208b67e-41fc-4b8a-bf91-0124ef8f36e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:51.618279 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-6208b67e-41fc-4b8a-bf91-0124ef8f36e8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067112 May 16 16:49:51.618808 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 27/54] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 16 16:49:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:52.494281 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:52.495804 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 16 16:49:52.496198 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:52.689109 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-50fb137b-cdfd-4d86-a812-0d858b37b332 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:52.705288 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-50fb137b-cdfd-4d86-a812-0d858b37b332 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066219 May 16 16:49:52.705843 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 28/56] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 16 16:49:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:53.592812 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:53.593850 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 16 16:49:53.594252 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 29/57] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:53.781210 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-a7fb286d-fd82-4403-93ef-f33d329d4f8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:53.798351 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-a7fb286d-fd82-4403-93ef-f33d329d4f8d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067502 May 16 16:49:53.798883 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 29/58] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 16 16:49:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:54.676791 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:54.677809 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 16 16:49:54.678220 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 30/59] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:54.864494 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-d8dcb070-5b30-4474-a6d3-14144d3f5883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:49:54.882809 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-d8dcb070-5b30-4474-a6d3-14144d3f5883 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068307 May 16 16:49:54.883338 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 30/60] 10.222.0.70 () {64 vars in 1235 bytes} [Mon May 16 16:49:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:49:55.778637 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:55.779620 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 16 16:49:55.780015 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 31/61] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:49:55.971080 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-6bae57bd-253c-496d-a1eb-e8ba9119c43e admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:49:55.990176 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-6bae57bd-253c-496d-a1eb-e8ba9119c43e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069486 May 16 16:49:55.990647 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 31/62] 10.222.0.70 () {60 vars in 1202 bytes} [Mon May 16 16:49:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:50:57.933061 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:50:57.934079 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-3bf8ef66-5fd5-460d-aa41-c7434c770a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 16 16:50:57.934470 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 930 bytes} [Mon May 16 16:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:50:57.990914 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-84accdf2-952d-468e-8120-c12aa90010a5 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:50:58.010694 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-84accdf2-952d-468e-8120-c12aa90010a5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070363 May 16 16:50:58.011221 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 32/64] 10.222.0.70 () {60 vars in 1291 bytes} [Mon May 16 16:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:50:58.033336 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-9f1522f9-ca82-4f74-8209-df9cb6e388e7 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:50:58.041192 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-9f1522f9-ca82-4f74-8209-df9cb6e388e7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011556 May 16 16:50:58.041701 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 33/65] 10.222.0.70 () {60 vars in 1282 bytes} [Mon May 16 16:50:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:50:58.052382 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-c6f0bd0a-108f-4293-9c4b-a14c78a222da admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:50:58.060362 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-c6f0bd0a-108f-4293-9c4b-a14c78a222da admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011526 May 16 16:50:58.060876 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 33/66] 10.222.0.70 () {60 vars in 1285 bytes} [Mon May 16 16:50:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:50:58.071271 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:50:58.079705 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011742 May 16 16:50:58.080238 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 34/67] 10.222.0.70 () {60 vars in 1285 bytes} [Mon May 16 16:50:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:50:58.091904 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-7bcf2293-1026-4253-89bb-de6e5c2e0382 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:50:58.099520 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-7bcf2293-1026-4253-89bb-de6e5c2e0382 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011205 May 16 16:50:58.100038 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 34/68] 10.222.0.70 () {60 vars in 1282 bytes} [Mon May 16 16:50:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:54:30.897315 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:30.898365 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 16 16:54:30.898761 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:54:31.162122 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-d5a4d75f-7e8c-4b76-9cb6-ecd16ce67a01 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:31.163289 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:54:31.163289 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: warnings.warn(msg) May 16 16:54:31.164472 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-d5a4d75f-7e8c-4b76-9cb6-ecd16ce67a01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:31.164905 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-d5a4d75f-7e8c-4b76-9cb6-ecd16ce67a01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:31.165678 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-d5a4d75f-7e8c-4b76-9cb6-ecd16ce67a01 admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:31.166122 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-d5a4d75f-7e8c-4b76-9cb6-ecd16ce67a01 admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:31.198285 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-d5a4d75f-7e8c-4b76-9cb6-ecd16ce67a01 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145379 May 16 16:54:31.198835 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 35/70] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 16 16:54:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:54:32.092376 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:32.093374 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 16 16:54:32.093797 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:54:32.283034 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-47551cc9-7c6d-45ac-9760-cfbbddb8f1b2 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:32.284199 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:54:32.284199 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: warnings.warn(msg) May 16 16:54:32.285361 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-47551cc9-7c6d-45ac-9760-cfbbddb8f1b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:32.285840 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-47551cc9-7c6d-45ac-9760-cfbbddb8f1b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:32.287119 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-47551cc9-7c6d-45ac-9760-cfbbddb8f1b2 admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:32.287532 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-47551cc9-7c6d-45ac-9760-cfbbddb8f1b2 admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:32.306365 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-47551cc9-7c6d-45ac-9760-cfbbddb8f1b2 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073545 May 16 16:54:32.306833 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 36/72] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 16 16:54:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:54:43.614449 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:43.615497 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 16 16:54:43.615888 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 37/73] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:54:43.808068 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-c035038f-454d-40fa-aa58-182c7b15dd49 admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:43.809243 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:54:43.809243 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: warnings.warn(msg) May 16 16:54:43.810434 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-c035038f-454d-40fa-aa58-182c7b15dd49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:43.810864 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-c035038f-454d-40fa-aa58-182c7b15dd49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:43.811627 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-c035038f-454d-40fa-aa58-182c7b15dd49 admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:43.812042 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-c035038f-454d-40fa-aa58-182c7b15dd49 admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:43.836575 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-c035038f-454d-40fa-aa58-182c7b15dd49 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078229 May 16 16:54:43.837111 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 37/74] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 16 16:54:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:54:44.733342 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: DEBUG nova.api.openstack.wsgi [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] Calling method '>' {{(pid=102636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:44.734372 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: INFO nova.api.openstack.requestlog [None req-0138ae71-ce14-4c87-be03-c1e31bd8eb15 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 16 16:54:44.734771 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: [pid: 102636|app: 0|req: 38/75] 10.222.0.70 () {56 vars in 1074 bytes} [Mon May 16 16:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:54:44.925901 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG nova.api.openstack.wsgi [None req-0e71703a-f419-4130-beb7-b343a39d170e admin admin] Calling method '>' {{(pid=102637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:54:44.927673 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:54:44.927673 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: warnings.warn(msg) May 16 16:54:44.928851 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-0e71703a-f419-4130-beb7-b343a39d170e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:44.929307 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-0e71703a-f419-4130-beb7-b343a39d170e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:44.930120 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-0e71703a-f419-4130-beb7-b343a39d170e admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:54:44.930543 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: DEBUG oslo_concurrency.lockutils [None req-0e71703a-f419-4130-beb7-b343a39d170e admin admin] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:54:44.952288 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: INFO nova.api.openstack.requestlog [None req-0e71703a-f419-4130-beb7-b343a39d170e admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077659 May 16 16:54:44.952760 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: [pid: 102637|app: 0|req: 38/76] 10.222.0.70 () {60 vars in 1193 bytes} [Mon May 16 16:54:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:55:43.784591 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: Mon May 16 16:55:43 2022 - graceful shutdown triggered... May 16 16:55:43.784699 dv-cinder-839987-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 16:55:43.785591 dv-cinder-839987-4-iscsi devstack@n-api.service[102636]: Gracefully killing worker 1 (pid: 102636)... May 16 16:55:43.786001 dv-cinder-839987-4-iscsi devstack@n-api.service[102637]: Gracefully killing worker 2 (pid: 102637)... May 16 16:55:44.786467 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: worker 1 buried after 1 seconds May 16 16:55:44.786467 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: worker 2 buried after 1 seconds May 16 16:55:44.786467 dv-cinder-839987-4-iscsi devstack@n-api.service[102635]: goodbye to uWSGI. May 16 16:55:44.787956 dv-cinder-839987-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 16:55:44.788514 dv-cinder-839987-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 16:55:44.791242 dv-cinder-839987-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 16:55:44.804406 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 16:55:44 2022] *** May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: nodename: dv-cinder-839987-4-iscsi May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: machine: x86_64 May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: clock source: unix May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: pcre jit disabled May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: detected number of CPU cores: 4 May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: current working directory: / May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: detected binary path: /usr/bin/uwsgi-core May 16 16:55:44.822188 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: your processes number limit is 47680 May 16 16:55:44.823077 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: your memory page size is 4096 bytes May 16 16:55:44.823077 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: detected max file descriptor number: 2048 May 16 16:55:44.823077 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: lock engine: pthread robust mutexes May 16 16:55:44.823077 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: thunder lock: enabled May 16 16:55:44.823077 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 16:55:44.823077 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 16:55:44.872217 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: Python main interpreter initialized at 0x55db3c1aa9c0 May 16 16:55:44.872217 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: python threads support enabled May 16 16:55:44.872217 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: your server socket listen backlog is limited to 100 connections May 16 16:55:44.872217 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: your mercy for graceful operations on workers is 90 seconds May 16 16:55:44.872663 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: mapped 403077 bytes (393 KB) for 2 cores May 16 16:55:44.872663 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: *** Operational MODE: preforking *** May 16 16:55:44.872934 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: *** uWSGI is running in multiple interpreter mode *** May 16 16:55:44.872934 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: spawned uWSGI master process (pid: 117167) May 16 16:55:44.873161 dv-cinder-839987-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 16:55:44.873776 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: spawned uWSGI worker 1 (pid: 117183, cores: 1) May 16 16:55:44.874347 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: spawned uWSGI worker 2 (pid: 117184, cores: 1) May 16 16:55:44.874656 dv-cinder-839987-4-iscsi devstack@n-api.service[117167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 16:55:46.096454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 16:55:46.098042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 16:55:46.907381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:55:46.907381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: from cryptography.utils import int_from_bytes May 16 16:55:46.907736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:55:46.907736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: from cryptography.utils import int_from_bytes May 16 16:55:46.934204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:55:46.934204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: from cryptography.utils import int_from_bytes May 16 16:55:46.934598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:55:46.934598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: from cryptography.utils import int_from_bytes May 16 16:55:49.366664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 16:55:49.367213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 16:55:49.367483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 16:55:49.367831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 16:55:49.368093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 16:55:49.368487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.368825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.369153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.369478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.369847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.370170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.370497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.370835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.371160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.371426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.371749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.372079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-4-iscsi {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.372409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.372723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.373040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.373368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.373678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.374034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.374349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.374864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.380560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-4-iscsi {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.381772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.382118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.382524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.382694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.383421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.383421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.383674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.383938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.384253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.384570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.384827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.385142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.385477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.385824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.386154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.386412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.386668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.386995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.387322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.387637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.387953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.388266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.388579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.388892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.389205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.389516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.389852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.390180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.390501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.390830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.391146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.391473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.391877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.392136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.392449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.392795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.393119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.393433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.393774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.394104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.394419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.394736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.395054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.395384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.395702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.396008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.396264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.396572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.396911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.397237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.397548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.397883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.398201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.398509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.398822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.399136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.399449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.399759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.400071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.400383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.400697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.401007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.401315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.401639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.401987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.402299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.402610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.402920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.403229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.403553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.403865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.404174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.404506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.411518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.412112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.413654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.413654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.413654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.416961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.421227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.422443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.423539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.424711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.424711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.424711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.424711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.425258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.425400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.425956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.426151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.426437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.426650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.426974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.427293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.427610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.427928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.428840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.429246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.429408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 16:55:49.429948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.430109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 16:55:49.430261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.430261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.430556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 16:55:49.430708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.430862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 16:55:49.431008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.431168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 16:55:49.431327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.431478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.431635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.431780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.431931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.432084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.432240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.432390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.432543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.432693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.432842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.433010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.433156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.433307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.433450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.433592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.433759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.433922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.434079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.434233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.434379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.434528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.434672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.434824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-4-iscsi {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.434985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.435137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.435282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.435433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.435584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.435769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.436212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.436374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.436638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.436789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.437019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.437167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.437320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.437482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.437632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.437632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.437970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.437970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.438267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.438410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.438553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.438553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.438845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.438988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.439151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.439151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.439649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.439807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.439959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.440110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.440261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.440406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.440549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.440699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.440851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.440994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.441138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.441138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.441432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-4-iscsi {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.441584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.441750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.441902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.442055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.442206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.442363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.442522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.442672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.442816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.442967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.443129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.443273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.443424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.443569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.443870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.444040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.444233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.444394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.444539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.444691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.444841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.444985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.445138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.445299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.445451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.445595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.445771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.445933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.446396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.446549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.446787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.446943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.447095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.447249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.447400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.447562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.447714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.447865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.448009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.448160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.448311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.448461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.448604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.448754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.448898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.449056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.449207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.449581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.449581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.449935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.450080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.450235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.450379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.450524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.450675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.450830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.450976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.451130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.451273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.451417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.451569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.451713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.451856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.452008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.452160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.452305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.452454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.452606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.452749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.452902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.453055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.453206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.453357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.453510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.453662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.453837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.453984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.454136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.454286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.454520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.454682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.454834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.454978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.455122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.455265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.455427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.455579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.455723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.455874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.456026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.456515 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.456671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.456914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.457072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.457225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.457376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.457527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.457672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.457870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.457870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.458147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.458292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.458443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.458595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.458739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.458882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.459025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.459168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.459340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.459729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.459881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.460037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.460192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.460346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.460500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.460654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.460798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.460942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.461093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.461244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.461394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.461547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.461691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.461893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.462051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.462202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.462355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.462500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.462642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.462785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.462927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.463077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.463235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.463379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.463523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.463665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.463816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.463977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.464205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.464351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.464495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.464646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.464789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.464939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.465097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.465250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.465402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.465553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.465704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.465901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.466059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.466211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.466599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.466874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.466874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.467233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.467376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.467520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.467680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.467824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.467977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.468121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.468282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.468426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.468583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.468729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.468880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.469030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.469173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.469315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.469473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.469637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.470049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.470205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.470349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.470503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.470660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.470806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.470950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.471093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.471243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.471395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.471546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.471697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.471842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.471994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.472137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.472288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.472441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.472584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.472727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.472870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.473019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.473182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.473332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.473483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.473627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.473788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.473939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.474099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.474261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.474421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.474565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.474715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.475366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.475525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.475669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.475819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.475964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:55:49.476117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.476277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.476451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.476810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.477101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.477568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.477727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.477906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.478059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.478204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.478204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.478613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.478769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.478922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.479066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.479210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.479360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.479525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.479679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.479851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.480186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.480337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.480481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.480635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.480798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.480951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.481094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.481238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.481390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.481553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.481704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.481929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.482975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.483129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.483281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.483433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.483593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.483738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.483889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.484931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.485083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.488263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.488456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.488627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.488789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.488946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.489100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.489246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.489397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.489562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.489724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.489918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.490290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.490445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.490626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.491297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.491481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.491634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.491634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.491921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.491921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.492213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.492378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.492529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.492687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.492846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.492997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.493156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.493374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.493570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.493570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.493933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.494853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.495164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.495327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.495495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.495646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.495803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.495963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.496123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.496123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.496423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.496574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.496724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.496959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.497114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.497274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.497425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.497623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.498281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.498484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.498661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.498661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.498958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.499112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.499261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.499445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.499638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.499845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.500001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.500152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.500566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.500736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.500889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.501047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.501208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.501369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.501528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.501679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.501908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.502069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.503199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.504343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.505193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.505344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.505502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.505652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.505652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.505980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.506174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.506346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.506497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.506647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.506807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.506956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.507113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.507270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.507428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.507579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.507746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.507904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.508445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.508634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.508866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.509039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.509192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.509350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.509516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.509678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.509902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.510070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.510221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.510371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.510716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.510876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.511978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.512146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.512297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.512446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.512603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.512762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.512921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.513092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.513251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.513408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.513558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.513708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.513896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.514976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.515149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.515299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.515448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.515611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.515775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.515928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.516084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.516234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.516390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.516553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.516703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.516852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.517002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.517168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.517326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.517491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.517648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.517834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.518002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.518176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.518693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.518693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.518693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.518693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.519310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.519475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.519475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.519790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.519941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.520098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.520249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.520399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.520557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.520915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.521083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.521236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.521386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.521542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.521757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.521929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.522080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.522239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.522389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.522538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.522697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.522855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.523988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.524146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.524297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.524456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.524614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.524773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.524924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.525080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.525239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.525403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.525562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.525719 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.525934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.526085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.526242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.526407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.526558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.526713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.526864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.527958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.528164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.528321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.528858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.529026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.529184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.529343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.529515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.529671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.529855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.530016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.530167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.530327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.530487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.530639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.530988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.531145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.531304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.531456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.531684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.531846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.531846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.532141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.532299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.532463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.532463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.532769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.532769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.533054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.533863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.534969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.535128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.535299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.535458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.535617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.535768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.535933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.536092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.536243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.536394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.536543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.536707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.536866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.537017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.537174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.537881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.538052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.538219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.538377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.538529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.539068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.539237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.539389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.539549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.539701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.539850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.540007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.540174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.540174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.540551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.540713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.541069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.541238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.541390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.541550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.541701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.541876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.542993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.543144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.543302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.543462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.543622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.543789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.544998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.545155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.545317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.545469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.545620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.545810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.546027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.546194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.546356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.546515 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.546672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.546887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.547044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.547498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.547672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.547833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.547992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.548142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.548292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.548450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.548611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.549060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.549318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.549489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.549640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.549822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.549994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.550148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.550306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.550464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.550616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.550781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.550932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.551286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.551446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.551598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.551760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.551919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.552079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.552230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.552380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.552537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.552689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.552848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.553044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.553708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.553892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.554044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.554213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.554384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.554609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.554785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.554949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.555101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.555271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.555271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.555561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.555720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.555886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.556980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.557130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.557279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.557429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.557592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.557772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.557941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.558094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.558251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.558419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.558579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.558731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.559143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.559320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.559561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.559801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.559980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.560145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.560297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.560447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.560604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.560769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.560945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.561106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.561462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.561629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.561837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.562961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.563121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.563283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.563433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.563590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.563749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.563909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.564067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.564220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.564376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.564535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.564699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.564850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.565971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.566129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.566288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.566448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.566612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.566763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.566920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.567071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.567231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.567231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.568115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.568273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.568441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.568624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.569523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.569829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.570981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.571140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.571304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.571684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.571837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.571988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.572146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.572381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.572544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.572697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.572697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.572996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.573146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.573306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.573458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.573610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.573781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.573939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.574090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.574256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.574420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.574571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.574734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.574892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.575059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.575221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.575386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.575546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.575711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.575862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.576961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.577895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.578193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.578352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.578512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.578681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.578833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.578992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.579143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.579614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.579796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.580079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.580244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.580397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.580555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.580716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.581110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.581290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.581463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.581855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.582018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.582191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.582505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.582670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.582831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.582983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.583919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.584003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.584096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.584182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.584894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.585941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586557 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.586917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.587980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.588964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.589934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.590944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.591997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.592974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.593989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.594904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.595967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.596945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.597945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.598967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.599968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.600949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.601764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.602032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.602451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.602642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.602779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.602975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.603105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.603301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.603432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.603631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.603747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.603968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.604061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.604282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.604375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.604596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.604699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.604913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.605010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.605227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.605311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.605540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.605631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.606077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.606239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.606404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.606565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.606737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.606897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.608151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.608304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.608467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.608618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.608779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.608929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.609943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.610120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.610213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.610643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.610753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.610950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.611121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.611215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.611451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.611584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.611765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.611909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.612157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.612262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.612384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.612486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.612692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.612855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.613971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.614054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.614282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.614370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.614593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.614681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.615988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.616204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.616294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.616516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.616609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.616827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.616926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.617141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.617247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.617449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.617540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.617773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.617882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.618086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.618187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.618415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.618507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.618724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.618823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.619982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.620082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.620290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.620382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.620606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.620717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.620930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.621022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.621261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.621360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.621573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.621662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.621925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.622993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.623211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.623312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.623529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.623637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.623848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.623949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.624159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.624257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.624477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.624589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.624797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.624907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.625115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.625215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.625428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.625536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.625850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.625966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.626086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.626201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.626407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.626514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.626724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.626972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.627067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.627308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.627414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.627642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.627743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.627939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.628031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.628282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.628441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.628682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.628824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.629892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 16:55:49.630094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.630416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.630754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.631591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.631939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.632295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.632603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.632926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.633248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.633570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.633963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.634286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.634598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.634921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.635241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.635561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.635879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.636197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.636516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.636839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.637277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.637596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.637942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.638268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.638597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.639095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.639460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.639785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.640174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.640430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.640964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.641284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.641624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.641979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.642310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.642633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.642959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.643288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.643599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.643913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.644226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.644538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.644845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.645174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.645488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.645824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.646149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.646462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.647606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.647964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.648291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.648627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.649015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.649288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.649601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.650075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.650327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.650644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.650969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.651283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.651607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.651904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.652223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.652544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.652856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.653168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.653479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.653874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.654186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.654498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.654808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.654910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_db.sqlalchemy.engines [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.655122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.655431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.655740 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.656049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.656355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.656671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.656980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.657290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.657597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.657937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.658247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.658559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.658916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.659250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.659563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.659871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.660194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.660510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.660834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.661151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.661467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.661842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.662165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.662784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.663103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.663428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.663799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.664135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.664445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.664756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.665067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.665396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.665711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.666049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.666364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.666681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.666995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.667308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.667623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.667940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.668305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.668626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.668939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.669252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.669570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.669939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.670265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.670588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.670909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.671231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.671543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.671857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.672172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.672486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.672806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.673145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.673462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.673795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.674227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.674545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.674868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.675195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.675510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.675837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.676165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.676482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.676807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.677123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.677458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.677826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.678189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.678525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.678837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.679146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.679455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.679771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.680096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.680411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.680720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.681028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.681345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.681654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.681987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.682298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.682609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.682925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.683234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.683542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.683858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.684167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.684476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.684786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.685100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.685408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.685720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.686051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.686360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.686667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.687005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.687413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.687737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.688068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.688387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.688717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.689037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.689365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.689694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.690039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.690356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.690693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.691010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.691350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.691648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.691964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.692277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.692593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.692927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.693262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.694123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.694501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.694774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.695100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.695420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.695737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.696072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.696388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.696701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.697020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.697336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.697651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.697996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.698316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.698647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.698977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.699291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.699623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.699955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.700306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.700623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.700974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.701308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.701628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.701968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.702281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:55:49.702529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 16:55:49.719560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.context [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316a0b18-3be7-4e60-8d08-0592b3fea63b(cell1) {{(pid=117184) load_cells /opt/stack/nova/nova/context.py:464}} May 16 16:55:49.723934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:55:49.725821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:55:49.726209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_db.sqlalchemy.engines [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.726655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:55:49.728897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:55:49.740394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_db.sqlalchemy.engines [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.742816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_db.sqlalchemy.engines [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.793036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.context [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316a0b18-3be7-4e60-8d08-0592b3fea63b(cell1) {{(pid=117183) load_cells /opt/stack/nova/nova/context.py:464}} May 16 16:55:49.797426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:55:49.799044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:55:49.799862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:55:49.801810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:55:49.812897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_db.sqlalchemy.engines [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.815109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_db.sqlalchemy.engines [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.902992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_db.sqlalchemy.engines [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:49.979927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_db.sqlalchemy.engines [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:55:50.223046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: WARNING keystonemiddleware.auth_token [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:55:50.231018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: WARNING keystonemiddleware.auth_token [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:55:50.304774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: WARNING keystonemiddleware.auth_token [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:55:50.312850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: WARNING keystonemiddleware.auth_token [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:55:50.583739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: WARNING keystonemiddleware.auth_token [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:55:50.590094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: WARNING keystonemiddleware.auth_token [None req-baf6f4ad-a538-4f06-9a9c-40951130f6b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:55:50.595211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db3c1aa9c0 pid: 117184 (default app) May 16 16:55:50.663568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: WARNING keystonemiddleware.auth_token [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 16:55:50.669882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: WARNING keystonemiddleware.auth_token [None req-7594b6dd-4935-42c0-ab8b-d308037c064a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 16:55:50.675178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db3c1aa9c0 pid: 117183 (default app) May 16 16:56:33.748416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6e807ac8-7798-4059-84a5-a0e01ccb6a41 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Action: 'create', calling method: .version_select at 0x7fead01cf280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1973812988"}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:33.853573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f4f73f1a-8646-4411-bfd0-7ad969feec58 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Action: 'create', calling method: .version_select at 0x7fead01cf280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-39422634", "metadata": {"Type": "work"}}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:35.603522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f4f73f1a-8646-4411-bfd0-7ad969feec58 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.199463 May 16 16:56:35.604485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 16 16:56:32 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3202 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 16:56:35.676966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6e807ac8-7798-4059-84a5-a0e01ccb6a41 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.520713 May 16 16:56:35.677652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1/2] 10.222.0.70 () {60 vars in 1154 bytes} [Mon May 16 16:56:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3524 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 16:56:35.694338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d2b1509-6158-4215-84fc-ea5098f18c31 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Calling method '.version_select at 0x7fead0028280>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:35.830045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d2b1509-6158-4215-84fc-ea5098f18c31 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d" status: 200 len: 351 microversion: 2.1 time: 0.140340 May 16 16:56:35.830636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:35 2022] GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:35.836287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d794a1a2-f0a0-4d61-80cf-7bbd75fc4c79 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead0028310>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:36.034135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-824553328", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "networks": [{"uuid": "39a8ca50-06c9-46e3-ac07-b70ecde267cf"}]}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:36.187698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d794a1a2-f0a0-4d61-80cf-7bbd75fc4c79 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 200 len: 345 microversion: 2.1 time: 0.355559 May 16 16:56:36.188459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:35 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 345 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:36.260645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] validate_networks() for [('39a8ca50-06c9-46e3-ac07-b70ecde267cf', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:56:36.844312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-74b1de7b-f5a2-4622-a31f-2ad75c5d43b9 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Calling method '.version_select at 0x7fead0028a60>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:36.945790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-74b1de7b-f5a2-4622-a31f-2ad75c5d43b9 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d" status: 200 len: 352 microversion: 2.1 time: 0.105954 May 16 16:56:36.951508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 4/5] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:36 2022] GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:36.962983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f585a65-9a40-4a93-8291-4dd04700c878 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Calling method '.version_select at 0x7fead002f160>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:37.072002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f585a65-9a40-4a93-8291-4dd04700c878 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d" status: 200 len: 352 microversion: 2.1 time: 0.114039 May 16 16:56:37.072583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 5/6] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:36 2022] GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:56:37.093756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f5cdef5-6944-4bd1-ad5c-b4e76b964930 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Calling method '.version_select at 0x7fead002f820>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:37.219848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f5cdef5-6944-4bd1-ad5c-b4e76b964930 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d" status: 202 len: 0 microversion: 2.1 time: 0.133081 May 16 16:56:37.220482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 6/7] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 16:56:37 2022] DELETE /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 16:56:37.227627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce34822b-e2a3-47da-b8d9-bd46632d64fe tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead0028b80>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:37.322490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce34822b-e2a3-47da-b8d9-bd46632d64fe tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 200 len: 346 microversion: 2.1 time: 0.100637 May 16 16:56:37.323067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 7/8] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:37 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:37.329420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-941a4524-49f8-4eed-b680-df3479cdb135 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Calling method '.version_select at 0x7fead0028160>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:37.426878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-941a4524-49f8-4eed-b680-df3479cdb135 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d" status: 200 len: 351 microversion: 2.1 time: 0.102585 May 16 16:56:37.427447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 8/9] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:37 2022] GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:37.432484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61e1d69e-2fb3-40ae-beff-5c710249bd5f tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Action: 'create', calling method: .version_select at 0x7fead002faf0>, body: {"snapshot": {"volume_id": "d905cd70-1422-4cf5-afc0-b675664d047e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-137959690"}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:37.826877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61e1d69e-2fb3-40ae-beff-5c710249bd5f tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.398061 May 16 16:56:37.827759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 9/10] 10.222.0.70 () {60 vars in 1161 bytes} [Mon May 16 16:56:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:37.837060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7ebb2f21-433e-44c0-87c6-ba9bfaa671ae tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead0028040>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:37.888662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7ebb2f21-433e-44c0-87c6-ba9bfaa671ae tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 200 len: 286 microversion: 2.1 time: 0.055176 May 16 16:56:37.896894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 10/11] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:37 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:37.899731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2e001e42-8810-4fa2-9834-34e9a139306e tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead0028c10>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:37.974439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2e001e42-8810-4fa2-9834-34e9a139306e tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.078918 May 16 16:56:37.975330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 11/12] 10.222.0.70 () {58 vars in 1139 bytes} [Mon May 16 16:56:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:56:37.987058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-75cabf75-4394-44b1-9c8e-8a1af746a302 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead002f790>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:38.040554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-75cabf75-4394-44b1-9c8e-8a1af746a302 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 200 len: 286 microversion: 2.1 time: 0.058286 May 16 16:56:38.042011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 12/13] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:37 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:56:38.139117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:56:38.139749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:56:38.140347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:56:38.140876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:56:38.141475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:56:38.196641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:38.197086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:38.197919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:38.198349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:38.259070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Getting quotas for project a145ae754d55458792b86bdda0ceb304. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:56:38.268277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Getting quotas for user 0cfe14bbc5f34432882bf74de0536ab4 and project a145ae754d55458792b86bdda0ceb304. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:56:38.301539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:56:38.304581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:56:38.439064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bbc76f8e-2247-4f00-a569-c1cec1b8c7e4 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Calling method '.version_select at 0x7fead0028dc0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:38.497571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a9acdb64-d16f-4025-9084-85383b6fa251 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.891376 May 16 16:56:38.499000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-bbc76f8e-2247-4f00-a569-c1cec1b8c7e4 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] HTTP exception thrown: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bbc76f8e-2247-4f00-a569-c1cec1b8c7e4 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Request method failure captured: May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d HTTP/1.1 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJA_Gj0tYyGJ1jIlvI9Q9XUwS6yBSWgeM7N4BeVxXc5qElBwiK2mKKjk2GN3_8ZRu6MDk_1XTqfYio4RuujRvaO4f0E0w-rJ8CQAMLNf85lIbOhbbUyNytvqgPBaIVSFtcMwR0u6um8-68vMJkIP6JGBd9CKCIchBl1K0RKOqcdtB4 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 7a7482e518374643873c71ea9afb5c82 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesGetTestJSON-1101392895 May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:56:38.503160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a7482e518374643873c71ea9afb5c82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a7482e518374643873c71ea9afb5c82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a7482e518374643873c71ea9afb5c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a7482e518374643873c71ea9afb5c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesGetTestJSON-1101392895 May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 7a7482e518374643873c71ea9afb5c82 May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesGetTestJSON-1101392895 May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesGetTestJSON-1101392895-project May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: e004b9ccb9cc4e299b4bbe6c499f0222 May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesGetTestJSON-1101392895-project May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '166e1596-eab7-443a-a6a9-c6b2b029e42d'} May 16 16:56:38.504541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. (HTTP 404) (Request-ID: req-e79ad568-dc57-4551-aa68-bbf9aeca3427) May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:38.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:38.567716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 16:56:38.570661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:38.572595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bbc76f8e-2247-4f00-a569-c1cec1b8c7e4 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] Returning 404 to user: Volume 166e1596-eab7-443a-a6a9-c6b2b029e42d could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:56:38.574091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 2/14] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:56:38.574335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bbc76f8e-2247-4f00-a569-c1cec1b8c7e4 tempest-VolumesGetTestJSON-1101392895 tempest-VolumesGetTestJSON-1101392895-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d" status: 404 len: 109 microversion: 2.1 time: 0.069403 May 16 16:56:38.574335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 13/15] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:38 2022] GET /compute/v2.1/os-volumes/166e1596-eab7-443a-a6a9-c6b2b029e42d => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 16:56:38.574562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6e8ccd70-ca1d-473b-b14e-cc29efff963b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:38.574562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6e8ccd70-ca1d-473b-b14e-cc29efff963b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:38.788780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6e8ccd70-ca1d-473b-b14e-cc29efff963b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:38.810322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6e8ccd70-ca1d-473b-b14e-cc29efff963b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1214 microversion: 2.1 time: 0.304710 May 16 16:56:38.810956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 3/16] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:38 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:39.053518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6c758f16-1650-4f53-8ecd-f54767b4461a tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead09fba60>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:39.127624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6c758f16-1650-4f53-8ecd-f54767b4461a tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 200 len: 286 microversion: 2.1 time: 0.078902 May 16 16:56:39.128570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 14/17] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:39 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:39.827330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bce13fdc-fc77-44a3-b8b8-98aa5fdd8ddf tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:39.828815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bce13fdc-fc77-44a3-b8b8-98aa5fdd8ddf tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:40.054469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bce13fdc-fc77-44a3-b8b8-98aa5fdd8ddf tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:40.061604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bce13fdc-fc77-44a3-b8b8-98aa5fdd8ddf tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1214 microversion: 2.1 time: 0.238016 May 16 16:56:40.093185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 4/18] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:39 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:40.139362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c68d1b4-09b7-474e-bd65-7df95bbd64c2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead0028ee0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:40.188070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3c68d1b4-09b7-474e-bd65-7df95bbd64c2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 200 len: 286 microversion: 2.1 time: 0.052384 May 16 16:56:40.195770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 15/19] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:40 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:41.084411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1b493521-edca-4467-ac3c-e52d84bb8fc1 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:41.085072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1b493521-edca-4467-ac3c-e52d84bb8fc1 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:41.190918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b493521-edca-4467-ac3c-e52d84bb8fc1 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:41.202492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9e15cb33-b580-4924-8875-547b039d35b8 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead001b4c0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:41.215258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1b493521-edca-4467-ac3c-e52d84bb8fc1 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1214 microversion: 2.1 time: 0.134589 May 16 16:56:41.227532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 5/20] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:41 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:41.295715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9e15cb33-b580-4924-8875-547b039d35b8 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 200 len: 287 microversion: 2.1 time: 0.097136 May 16 16:56:41.306811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-209f0a1a-dbc9-4fe4-ba50-39f025ea3a65 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feaceedee50>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:41.309819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 16/21] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:41 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:56:41.518981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-209f0a1a-dbc9-4fe4-ba50-39f025ea3a65 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 202 len: 0 microversion: 2.1 time: 0.216110 May 16 16:56:41.519564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 6/22] 10.222.0.70 () {58 vars in 1253 bytes} [Mon May 16 16:56:41 2022] DELETE /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 16:56:41.528869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-01bc6124-7f0b-499b-b279-3d80ea547165 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead001bb80>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:41.586375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-01bc6124-7f0b-499b-b279-3d80ea547165 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 200 len: 286 microversion: 2.1 time: 0.061154 May 16 16:56:41.586938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 17/23] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:41 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:42.232306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:42.232928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:42.245048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:42.245506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:42.246338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:42.246781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:42.600278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1b5d5e4-f79e-44c3-a682-881f276f50d2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacffa7280>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:42.769689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-d1b5d5e4-f79e-44c3-a682-881f276f50d2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] HTTP exception thrown: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1b5d5e4-f79e-44c3-a682-881f276f50d2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Request method failure captured: May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 HTTP/1.1 May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJAtsrhYV3gByo-cbmXmQGXoCQlGCvVxX_2phjXojCzo4tVbSy3-GW7IPaawzLHa3pBlHPxh3vIhGxyz-xa7e9Kc8XHwL4EP-0ApQbAwwLpUNF66lTknB7w7tOJrxRfSerU2mG8suWll1WyMDJKPoOiCJ_ZqLrLqQ13DIaz_UfZz2k May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:56:42.772416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4381b412569f4471a4564fda366d6d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4381b412569f4471a4564fda366d6d20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: f85ab1846ce244598b1256a36cde7bf2 May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'b3a771ec-423f-436f-b475-e49d11378321'} May 16 16:56:42.773600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. (HTTP 404) (Request-ID: req-70123010-2f51-4a78-abcd-ededba6c4bff) May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.774335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:42.775188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 16:56:42.776493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1b5d5e4-f79e-44c3-a682-881f276f50d2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Returning 404 to user: Snapshot b3a771ec-423f-436f-b475-e49d11378321 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:56:42.778421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d1b5d5e4-f79e-44c3-a682-881f276f50d2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321" status: 404 len: 111 microversion: 2.1 time: 0.177491 May 16 16:56:42.779631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 18/24] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 16:56:42 2022] GET /compute/v2.1/os-snapshots/b3a771ec-423f-436f-b475-e49d11378321 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 16:56:42.783173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b0c4e815-bd16-42a0-ab52-7a548b8083a5 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7fead09fb820>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:43.026603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b0c4e815-bd16-42a0-ab52-7a548b8083a5 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 202 len: 0 microversion: 2.1 time: 0.247409 May 16 16:56:43.027752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 19/25] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 16:56:42 2022] DELETE /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 16:56:43.035485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3224072a-42c5-4e5e-b92c-58c8ed0e5b7e tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacffa7040>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:43.162465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3224072a-42c5-4e5e-b92c-58c8ed0e5b7e tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 200 len: 345 microversion: 2.1 time: 0.130530 May 16 16:56:43.163144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 20/26] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:43 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:43.236834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:43.257692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4c5cedaa-5fa4-418c-83cb-36b53c079f92 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1266 microversion: 2.1 time: 1.029128 May 16 16:56:43.271183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 7/27] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:42 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1266 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:44.178414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83c755fb-8988-44a3-aa9e-483079dd8f7e tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacffa7ca0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:44.273405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83c755fb-8988-44a3-aa9e-483079dd8f7e tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 200 len: 345 microversion: 2.1 time: 0.100699 May 16 16:56:44.277105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:44.277725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:44.280335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 21/28] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:44 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:44.284850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:44.285301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:44.294387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:44.294888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:44.458447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:44.474568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a29fdf81-7353-430b-aa2d-bfc171c0686e tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1272 microversion: 2.1 time: 0.201374 May 16 16:56:44.475168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 8/29] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:44 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:45.139512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b8035f3-9dcb-4243-8b43-2cc2543cbea3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: .version_select at 0x7feacffa7940>, body: {"keypair": {"name": "tempest-keypair-231164811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELDLwFH3udBRgeLByl4Cn1WZxowi3DltAEYm9MYP+3DMDwF4y3vx1W6x8MKx09AFGj0cZX1+sjVxCaZ6xkKP7rPnxrsTf9QfQ+Dchd4+6qQ0fvzCZiF+1oxiPPKN2XZ/g=="}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:45.238542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-7b8035f3-9dcb-4243-8b43-2cc2543cbea3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:56:45.255527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-7b8035f3-9dcb-4243-8b43-2cc2543cbea3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:56:45.287238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3bbbdca5-8902-4a43-a291-35d015cd80c4 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacee94280>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:45.351122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b8035f3-9dcb-4243-8b43-2cc2543cbea3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.437994 May 16 16:56:45.354895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 22/30] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 16:56:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:45.422987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3bbbdca5-8902-4a43-a291-35d015cd80c4 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 200 len: 345 microversion: 2.1 time: 0.139338 May 16 16:56:45.430282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 9/31] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:45 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:45.495138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:45.497980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:45.573958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:45.575437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:45.577986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:45.580243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:46.362153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:46.420975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-070a1c88-80fc-429e-8225-e776a03ae2aa tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1272 microversion: 2.1 time: 0.932159 May 16 16:56:46.431397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 23/32] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:45 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1272 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:46.464035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c8b38ff1-cdf0-4939-8c64-717cdadff0a2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacf670a60>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:46.589780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cad882f8-7aef-4272-9c85-544327642ea9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'create', calling method: .version_select at 0x7feacee94d30>, body: {"keypair": {"name": "tempest-keypair-221854785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq8XIFMyuI0BaxzO7+MiYsEcfQhdmY0K2Ii0B4fXtn/7Wr0EHODOp1xqeE69ez9TC+bmpT6LJ1jVZta53UqUBnHaB0sXToYWD7eGyZOnASirR5uG9HYhvbIOxtX9D4qGg=="}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:46.609482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-c8b38ff1-cdf0-4939-8c64-717cdadff0a2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] HTTP exception thrown: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c8b38ff1-cdf0-4939-8c64-717cdadff0a2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Request method failure captured: May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e HTTP/1.1 May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJAtsrhYV3gByo-cbmXmQGXoCQlGCvVxX_2phjXojCzo4tVbSy3-GW7IPaawzLHa3pBlHPxh3vIhGxyz-xa7e9Kc8XHwL4EP-0ApQbAwwLpUNF66lTknB7w7tOJrxRfSerU2mG8suWll1WyMDJKPoOiCJ_ZqLrLqQ13DIaz_UfZz2k May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:56:46.611468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4381b412569f4471a4564fda366d6d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4381b412569f4471a4564fda366d6d20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: f85ab1846ce244598b1256a36cde7bf2 May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'd905cd70-1422-4cf5-afc0-b675664d047e'} May 16 16:56:46.612520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. (HTTP 404) (Request-ID: req-ff2630b2-0032-4871-ae41-b5af0d10bfde) May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.613186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:46.614152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 16:56:46.615184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.616201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.618589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c8b38ff1-cdf0-4939-8c64-717cdadff0a2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Returning 404 to user: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:56:46.620134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c8b38ff1-cdf0-4939-8c64-717cdadff0a2 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 404 len: 109 microversion: 2.1 time: 0.187424 May 16 16:56:46.637833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 24/33] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:46 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:56:46.662741 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-693ce467-56f5-41cf-a89f-13fd5cf3337b tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacf698dc0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:46.716375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-cad882f8-7aef-4272-9c85-544327642ea9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:56:46.723781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-cad882f8-7aef-4272-9c85-544327642ea9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for user 58633f982d3840dd88f631bcee882f5f and project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:56:46.751998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-693ce467-56f5-41cf-a89f-13fd5cf3337b tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] HTTP exception thrown: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-693ce467-56f5-41cf-a89f-13fd5cf3337b tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Request method failure captured: May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e HTTP/1.1 May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJAtsrhYV3gByo-cbmXmQGXoCQlGCvVxX_2phjXojCzo4tVbSy3-GW7IPaawzLHa3pBlHPxh3vIhGxyz-xa7e9Kc8XHwL4EP-0ApQbAwwLpUNF66lTknB7w7tOJrxRfSerU2mG8suWll1WyMDJKPoOiCJ_ZqLrLqQ13DIaz_UfZz2k May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:56:46.753999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4381b412569f4471a4564fda366d6d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4381b412569f4471a4564fda366d6d20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: f85ab1846ce244598b1256a36cde7bf2 May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'd905cd70-1422-4cf5-afc0-b675664d047e'} May 16 16:56:46.754987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. (HTTP 404) (Request-ID: req-41610c5a-11f8-4626-a853-e554cbf07113) May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.755661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 16:56:46.756570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 16:56:46.757448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-693ce467-56f5-41cf-a89f-13fd5cf3337b tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Returning 404 to user: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-693ce467-56f5-41cf-a89f-13fd5cf3337b tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 404 len: 109 microversion: 2.1 time: 0.116501 May 16 16:56:46.758320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 25/34] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 16:56:46 2022] DELETE /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:56:46.764047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-809ae103-3f2c-4344-b718-3a2c8a27f741 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Calling method '.version_select at 0x7feacf698af0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:46.843621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cad882f8-7aef-4272-9c85-544327642ea9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.479413 May 16 16:56:46.844297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 10/35] 10.222.0.70 () {62 vars in 1199 bytes} [Mon May 16 16:56:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 481 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 16:56:46.937347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-809ae103-3f2c-4344-b718-3a2c8a27f741 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] HTTP exception thrown: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-809ae103-3f2c-4344-b718-3a2c8a27f741 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Request method failure captured: May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e HTTP/1.1 May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJAtsrhYV3gByo-cbmXmQGXoCQlGCvVxX_2phjXojCzo4tVbSy3-GW7IPaawzLHa3pBlHPxh3vIhGxyz-xa7e9Kc8XHwL4EP-0ApQbAwwLpUNF66lTknB7w7tOJrxRfSerU2mG8suWll1WyMDJKPoOiCJ_ZqLrLqQ13DIaz_UfZz2k May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:56:46.939392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4381b412569f4471a4564fda366d6d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4381b412569f4471a4564fda366d6d20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4381b412569f4471a4564fda366d6d20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 4381b412569f4471a4564fda366d6d20 May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854947144 May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: f85ab1846ce244598b1256a36cde7bf2 May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854947144-project May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'd905cd70-1422-4cf5-afc0-b675664d047e'} May 16 16:56:46.940675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. (HTTP 404) (Request-ID: req-48c5aafa-b1fd-4620-82e2-2473e492b55e) May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.941576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 16:56:46.942713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 16:56:46.944476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. May 16 16:56:46.945574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:56:46.948581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-809ae103-3f2c-4344-b718-3a2c8a27f741 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] Returning 404 to user: Volume d905cd70-1422-4cf5-afc0-b675664d047e could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:56:46.948581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-809ae103-3f2c-4344-b718-3a2c8a27f741 tempest-VolumesSnapshotsTestJSON-1854947144 tempest-VolumesSnapshotsTestJSON-1854947144-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e" status: 404 len: 109 microversion: 2.1 time: 0.187808 May 16 16:56:46.948581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 26/36] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 16:56:46 2022] GET /compute/v2.1/os-volumes/d905cd70-1422-4cf5-afc0-b675664d047e => generated 109 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 16:56:47.455806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:47.455806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:47.486298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:47.490998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:47.491930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:47.492509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:47.956246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:47.969085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d69c1f0b-6108-4165-837c-f997d0c13b1f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1272 microversion: 2.1 time: 0.527646 May 16 16:56:47.976884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 11/37] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:47 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:48.996984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:48.997604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:49.007189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:49.007852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:49.008810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:49.009394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:49.202922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:49.215245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2c052d2d-2415-43d9-bc89-0147400af969 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1272 microversion: 2.1 time: 0.224729 May 16 16:56:49.217917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 27/38] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:48 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:50.234825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:50.235435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:50.244427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:50.244880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:50.245658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:50.253422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:50.318534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4bee4246-af05-46f5-89cb-700501d715ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'create', calling method: .version_select at 0x7feacee94e50>, body: {"keypair": {"name": "tempest-keypair-1662303654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCcF2nzdUGItd9Ixr/9/ClFA9VzDyiaC69B+mREpjAzCYELB7c3jyMhJ1YBlIoSPxFZhyTfIb8MJzAQ1wX9bWya3RLgxG8QRyW2cKDoP5AN6S8pPNxySQ7ELlmMophltg=="}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:50.383665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-4bee4246-af05-46f5-89cb-700501d715ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:56:50.406530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-4bee4246-af05-46f5-89cb-700501d715ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for user 189966fbd18f4152b6b54ba5492034e0 and project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:56:50.470419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4bee4246-af05-46f5-89cb-700501d715ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.439596 May 16 16:56:50.471879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 12/39] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 16:56:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:56:50.957253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:50.967521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4b3dd8c8-8f4b-4be2-832e-9462dd0c5e01 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.736505 May 16 16:56:50.968660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 28/40] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:50 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:51.000318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1127735598", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b"}], "security_groups": [{"name": "tempest-securitygroup--790008301"}], "key_name": "tempest-keypair-231164811", "user_data": "}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:51.588954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] validate_networks() for [('6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:56:51.985595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:51.986435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:52.045480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:52.046224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:52.047003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:52.055304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:54.462013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:54.485072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d79d1563-68c8-4a19-9ca5-bd77663762fc tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 2.503872 May 16 16:56:54.494218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 29/41] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:51 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:54.650018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:56:54.651044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:56:54.651538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:56:54.651958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:56:54.652376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:56:54.670945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:54.671842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:54.672789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:54.673358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:54.757246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:56:54.773759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:56:54.818671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:56:54.832646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:56:55.140279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2a25bd44-e928-4ac8-bfd7-ea1903651fbe tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.146780 May 16 16:56:55.140999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 13/42] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:56:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 4148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:56:55.152269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cb7c4fe7-076c-4059-96a7-f8fcfdd6a15e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:55.152863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cb7c4fe7-076c-4059-96a7-f8fcfdd6a15e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:55.408345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cb7c4fe7-076c-4059-96a7-f8fcfdd6a15e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:55.442338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cb7c4fe7-076c-4059-96a7-f8fcfdd6a15e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1241 microversion: 2.1 time: 0.285242 May 16 16:56:55.447352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 30/43] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:55 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1241 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:55.511659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:55.512377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:55.527110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:55.529883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:55.530782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:55.531229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:56.009804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-b4597175-4230-4853-be39-54a3b54faa4a req-3da258cc-210b-46b6-8016-470b825680e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4300ecf-816f-4b04-9586-2b819465b7ba", "tag": "0160d46d-ef6c-4b39-9f84-ef4e81166f59"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:56.043334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b4597175-4230-4853-be39-54a3b54faa4a req-3da258cc-210b-46b6-8016-470b825680e7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:56.043932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b4597175-4230-4853-be39-54a3b54faa4a req-3da258cc-210b-46b6-8016-470b825680e7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:56.096592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-b4597175-4230-4853-be39-54a3b54faa4a req-3da258cc-210b-46b6-8016-470b825680e7 service nova] Creating event network-changed:0160d46d-ef6c-4b39-9f84-ef4e81166f59 for instance e4300ecf-816f-4b04-9586-2b819465b7ba on hv-cinder-83998 May 16 16:56:56.097325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b4597175-4230-4853-be39-54a3b54faa4a req-3da258cc-210b-46b6-8016-470b825680e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117184) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 16:56:56.098657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:56.108240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:56.109552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:56.112653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:56.143243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.compute.rpcapi [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 16:56:56.144916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] Releasing lock "compute-rpcapi-router" {{(pid=117184) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 16:56:56.206248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-87d7eb2a-03cf-4918-8946-ab5885d1b0de None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313459 May 16 16:56:56.207443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 31/44] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:56:56.400267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:56.413477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-723b473a-6d70-4a26-9ffc-4377b22a9d8f tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.908008 May 16 16:56:56.424433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 14/45] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:55 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:56.488298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-376de691-c5cc-4a34-87b6-7d126d764cf3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:56.488298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-376de691-c5cc-4a34-87b6-7d126d764cf3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:57.161601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-376de691-c5cc-4a34-87b6-7d126d764cf3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:57.169230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-376de691-c5cc-4a34-87b6-7d126d764cf3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1241 microversion: 2.1 time: 0.709434 May 16 16:56:57.169798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 32/46] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:56 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1241 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:57.435644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:56:57.436289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:56:57.444909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:57.449695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:57.452756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:56:57.453233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:56:57.611164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1717407763", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abb8ab83-64bf-4f27-9dbf-594df92bc044"}], "security_groups": [{"name": "tempest-securitygroup--2108598954"}], "key_name": "tempest-keypair-221854785", "user_data": "}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:58.069563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] validate_networks() for [('abb8ab83-64bf-4f27-9dbf-594df92bc044', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:56:58.372298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:56:58.385303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-14917ca8-99a6-4d7c-9400-106bb64b666b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.955249 May 16 16:56:58.401894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 15/47] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:56:57 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:56:58.421428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2073293428", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4e65cf1-f81c-4353-9c14-c2e64e36a512"}], "security_groups": [{"name": "tempest-securitygroup--530404755"}], "key_name": "tempest-keypair-1662303654", "user_data": "}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:56:58.783018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] validate_networks() for [('a4e65cf1-f81c-4353-9c14-c2e64e36a512', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:57:01.341568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:57:01.344256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:57:01.346619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:57:01.347693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:57:01.349389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:57:01.373385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:01.374915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:01.376047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:01.376932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:01.456639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:57:01.470544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for user 189966fbd18f4152b6b54ba5492034e0 and project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:57:01.518462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:57:01.520748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:57:01.620368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-420e8c6d-24b9-4c80-92e5-fd88ec336000 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.210063 May 16 16:57:01.628873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 16/48] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:56:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 3226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:57:01.638507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:01.651921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:01.683383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:01.685239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:01.690412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:01.691333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:01.812995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:01.823236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-959fef35-a757-418f-88c7-baa4db47f7f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1299 microversion: 2.1 time: 0.190970 May 16 16:57:01.832690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 17/49] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:01 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:01.838811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:01.841286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:01.856960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:01.857479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:01.858400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:01.858887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:02.124223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:02.134231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-43826c9a-11e8-4649-9b61-0165d366562c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.308120 May 16 16:57:02.136314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 18/50] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:01 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:02.142102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7be33d02-51ec-4f7f-873b-3e8a16332bb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:02.142732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7be33d02-51ec-4f7f-873b-3e8a16332bb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:02.152330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:57:02.152839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:57:02.153307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:57:02.155340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:57:02.156074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:57:02.170243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:02.170999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:02.172194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:02.172986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:02.251742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:57:02.258202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for user 58633f982d3840dd88f631bcee882f5f and project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:57:02.285944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:57:02.290080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:57:02.361161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7be33d02-51ec-4f7f-873b-3e8a16332bb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:02.368490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7be33d02-51ec-4f7f-873b-3e8a16332bb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1238 microversion: 2.1 time: 0.231104 May 16 16:57:02.374924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 19/51] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1238 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:02.442330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-226f4835-58f1-4b7b-94ac-16eda704f265 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.836843 May 16 16:57:02.447377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 33/52] 10.222.0.70 () {62 vars in 1187 bytes} [Mon May 16 16:56:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 4842 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 16 16:57:02.455518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-548b5a37-6664-43a9-af36-062ff81bda06 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:02.456433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-548b5a37-6664-43a9-af36-062ff81bda06 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:02.671236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-548b5a37-6664-43a9-af36-062ff81bda06 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:02.692040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-548b5a37-6664-43a9-af36-062ff81bda06 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:02.697395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-548b5a37-6664-43a9-af36-062ff81bda06 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:02.700990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-548b5a37-6664-43a9-af36-062ff81bda06 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1281 microversion: 2.20 time: 0.249327 May 16 16:57:02.706466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 20/53] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1281 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:02.842955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:02.851864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:02.873637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:02.876877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:02.879099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:02.882346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.152074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:03.155416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:03.170477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.170941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.172130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.172724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.277395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:03.297866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d4ba5270-d3d1-414d-8c70-9400c7344387 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.460531 May 16 16:57:03.307240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 34/54] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:02 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:03.387076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:03.387798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:03.399737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.400412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.401376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.403910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.553638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:03.569058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7b5024f6-74be-44d2-9e1c-d4fb200c18e7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.422531 May 16 16:57:03.571178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 21/55] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:03 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:03.636601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:03.651890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-46066011-f9d0-4046-84e1-ecb5773ac0ef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1298 microversion: 2.1 time: 0.263308 May 16 16:57:03.654718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 35/56] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1298 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:03.726683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:03.727595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:03.745304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.746050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.753587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.754288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.852507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:03.865981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:03.867851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:03.869249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5394effa-d0d7-4d78-af7d-5594484eb91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1285 microversion: 2.20 time: 0.147865 May 16 16:57:03.884635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 22/57] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:03.921934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-3b7e7ea3-3153-4c27-a687-aef00a778678 req-0874cdcc-3b1e-4ddb-ac79-9cc50ad5ff82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21efdaa-3bbe-4f8b-953d-6baaaadb9b53", "tag": "21ca2048-d933-4aa6-b313-3a05ab94f9bb"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:03.940971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-3b7e7ea3-3153-4c27-a687-aef00a778678 req-0874cdcc-3b1e-4ddb-ac79-9cc50ad5ff82 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:03.942763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-3b7e7ea3-3153-4c27-a687-aef00a778678 req-0874cdcc-3b1e-4ddb-ac79-9cc50ad5ff82 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:03.969302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-3b7e7ea3-3153-4c27-a687-aef00a778678 req-0874cdcc-3b1e-4ddb-ac79-9cc50ad5ff82 service nova] Creating event network-changed:21ca2048-d933-4aa6-b313-3a05ab94f9bb for instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 on hv-cinder-83998 May 16 16:57:03.985663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-3b7e7ea3-3153-4c27-a687-aef00a778678 req-0874cdcc-3b1e-4ddb-ac79-9cc50ad5ff82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067655 May 16 16:57:03.988811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 36/58] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:04.314644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:04.315274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:04.321758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.323797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.324800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.325957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.588452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:04.589693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:04.600204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.603305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.604286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.604741 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.671294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:04.680644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6bfa8aff-945b-4dfd-8238-8350679c22b9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.369774 May 16 16:57:04.690763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 23/59] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:04 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:04.697189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:04.697853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:04.716805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.718193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.718974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.727737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.846520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:04.854899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2b6a862f-b547-4b1e-bd11-17874a97ade4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1296 microversion: 2.1 time: 0.162316 May 16 16:57:04.859135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 24/60] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:04.887952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:04.889095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:04.899606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.900943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:04.902176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:04.902810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:05.077781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:05.086935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:05.093289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:05.095869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7e925f4f-5669-4109-bfef-a4ac1e73cf3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1339 microversion: 2.20 time: 0.212204 May 16 16:57:05.098001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 25/61] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:05.287222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:05.300083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-db573b48-6126-4159-8a28-6f3826721ab7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.716152 May 16 16:57:05.310638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 37/62] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:04 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:05.707489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:05.708521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:05.719997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:05.720749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:05.722561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:05.723038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:05.875912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:05.876561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:05.889362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:05.890017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:05.893488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:05.894162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:06.059530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:06.073011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5c08e526-06ec-441f-8282-07e244dcbb04 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.369645 May 16 16:57:06.074495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 26/63] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:05 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:06.116865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:06.117952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:06.128502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:06.129240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:06.130502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:06.131158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:06.273915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:06.288518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:06.295832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:06.297334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-845af1ba-5735-4d3c-8667-125c16a59f58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1339 microversion: 2.20 time: 0.186119 May 16 16:57:06.299605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 27/64] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:06.321253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:06.324173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:06.341369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:06.344714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:06.345878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:06.347329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:06.622856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:06.633486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:06.637928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-67ea7bec-8958-4457-b21e-e2fdfa973332 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.763745 May 16 16:57:06.639362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 38/65] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:06.650739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fac7c303-c280-414b-938b-d1ab96c94ef8 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.334680 May 16 16:57:06.651672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 28/66] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:06 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:07.092954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:07.094465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:07.109324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.110153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.114419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.116225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.318940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:07.320907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:07.335194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.335653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.336454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.336911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.436344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:07.437568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:07.447567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:07.449554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f993a47d-8466-4f7f-8a4b-c6ab170400d8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.359743 May 16 16:57:07.450261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 39/67] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:07 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:07.450596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:07.452114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-90461f34-eef7-4fbe-9ce6-597a469ed932 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1339 microversion: 2.20 time: 0.139191 May 16 16:57:07.453152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 29/68] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:07.597229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-a3f02869-6d18-4374-b21a-b0364c60caa9 req-2c8c4979-3eb9-4ca5-bf1a-96b5e4ffe8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4300ecf-816f-4b04-9586-2b819465b7ba", "name": "network-vif-plugged", "status": "completed", "tag": "0160d46d-ef6c-4b39-9f84-ef4e81166f59"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:07.607703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a3f02869-6d18-4374-b21a-b0364c60caa9 req-2c8c4979-3eb9-4ca5-bf1a-96b5e4ffe8ac service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.608856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a3f02869-6d18-4374-b21a-b0364c60caa9 req-2c8c4979-3eb9-4ca5-bf1a-96b5e4ffe8ac service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.624007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-a3f02869-6d18-4374-b21a-b0364c60caa9 req-2c8c4979-3eb9-4ca5-bf1a-96b5e4ffe8ac service nova] Creating event network-vif-plugged:0160d46d-ef6c-4b39-9f84-ef4e81166f59 for instance e4300ecf-816f-4b04-9586-2b819465b7ba on hv-cinder-83998 May 16 16:57:07.633774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-a3f02869-6d18-4374-b21a-b0364c60caa9 req-2c8c4979-3eb9-4ca5-bf1a-96b5e4ffe8ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126367 May 16 16:57:07.634740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 40/69] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:07.655937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:07.656827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:07.664142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.665889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.666878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.667489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.696953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:07.701390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:07.733841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.735087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.752159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:07.752652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:07.935314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:07.951391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-846ce28d-c1a1-46d3-bdf5-90f8f1bd3523 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.299607 May 16 16:57:07.952150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 30/70] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:08.458553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:08.466223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:08.467078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:08.477688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3e64f63e-f8c0-46e6-ae16-2790dc0992c0 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.813353 May 16 16:57:08.480507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 41/71] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:07 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:08.492312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:08.492861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:08.493389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:08.493662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:08.494203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:08.496239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:08.510768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:08.511227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:08.512022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:08.516109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:08.944447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:08.953836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-891f34a8-9e32-4e58-be58-0ba695493d69 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.490019 May 16 16:57:08.964010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 31/72] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:08 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:08.984154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:08.995457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:08.997104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:09.002504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7dc657c-54f5-42c7-a6c9-df2480b03ab3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.518890 May 16 16:57:09.018341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 42/73] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:09.018341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:09.018341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:09.035384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.038124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.039059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.042245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.062220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-0597b95c-23e3-4aba-9030-3267b86b1a0d req-3b82dc6e-c31a-4ae7-9c79-34c11c095c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb86dab5-8d6b-4d24-969a-687c2224d48d", "tag": "0d2d13e9-d075-4dd0-a707-5f7669545169"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:09.075747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0597b95c-23e3-4aba-9030-3267b86b1a0d req-3b82dc6e-c31a-4ae7-9c79-34c11c095c12 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.076473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0597b95c-23e3-4aba-9030-3267b86b1a0d req-3b82dc6e-c31a-4ae7-9c79-34c11c095c12 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.110024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-0597b95c-23e3-4aba-9030-3267b86b1a0d req-3b82dc6e-c31a-4ae7-9c79-34c11c095c12 service nova] Creating event network-changed:0d2d13e9-d075-4dd0-a707-5f7669545169 for instance bb86dab5-8d6b-4d24-969a-687c2224d48d on hv-cinder-83998 May 16 16:57:09.111128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0597b95c-23e3-4aba-9030-3267b86b1a0d req-3b82dc6e-c31a-4ae7-9c79-34c11c095c12 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117183) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 16:57:09.112386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.112968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.114025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.114844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.127546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.compute.rpcapi [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 16:57:09.128617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] Releasing lock "compute-rpcapi-router" {{(pid=117183) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 16:57:09.166635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-63c1e8b6-1005-4e54-9968-27b15949be36 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201086 May 16 16:57:09.167298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 32/74] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:09.352333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:09.359616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c0edcefb-5b59-4147-8d33-20877739eaba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.349463 May 16 16:57:09.360202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 43/75] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:09.512175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:09.513192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:09.521136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.521690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.522643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.523568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.929641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:09.937600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d0e5ab05-d051-4bab-bfbe-c7e094cd8fed tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.444186 May 16 16:57:09.946950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 33/76] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:09 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:09.971059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:09.971635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:09.980354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.980735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:09.984879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:09.985324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:10.027354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:10.028252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:10.035282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:10.035986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:10.037553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:10.040208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:10.273129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:10.287195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:10.290805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:10.292200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aa6c557d-060b-439c-87ed-b699fd79819f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.269468 May 16 16:57:10.292674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 34/77] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:10.383269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:10.384301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:10.402368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:10.421709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:10.425539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:10.425877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:10.449019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:10.456911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-65049883-c255-48ad-a5f4-9384c067a7c6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.489823 May 16 16:57:10.475164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 44/78] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:09 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:10.684352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:10.694733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e1fe3761-a53b-4a13-aa9d-3b0bd35fb061 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.318478 May 16 16:57:10.695965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 35/79] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:10.958039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:10.958664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:10.964794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:10.965244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:10.966232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:10.966810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.049928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-e35f8421-20fd-4e44-8f73-37751104320e req-83fc30f9-37a6-4ad6-b0cf-7bfba224d789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21efdaa-3bbe-4f8b-953d-6baaaadb9b53", "name": "network-vif-plugged", "status": "completed", "tag": "21ca2048-d933-4aa6-b313-3a05ab94f9bb"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:11.066281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-e35f8421-20fd-4e44-8f73-37751104320e req-83fc30f9-37a6-4ad6-b0cf-7bfba224d789 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.067143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-e35f8421-20fd-4e44-8f73-37751104320e req-83fc30f9-37a6-4ad6-b0cf-7bfba224d789 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.093761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-e35f8421-20fd-4e44-8f73-37751104320e req-83fc30f9-37a6-4ad6-b0cf-7bfba224d789 service nova] Creating event network-vif-plugged:21ca2048-d933-4aa6-b313-3a05ab94f9bb for instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 on hv-cinder-83998 May 16 16:57:11.107747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-e35f8421-20fd-4e44-8f73-37751104320e req-83fc30f9-37a6-4ad6-b0cf-7bfba224d789 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061343 May 16 16:57:11.108857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 36/80] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:57:11.198065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-ce79a18b-ddb2-412c-878b-66db154bd555 req-0673c033-3c1a-4523-8c0f-d9c8adf17bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:11.216714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-ce79a18b-ddb2-412c-878b-66db154bd555 req-0673c033-3c1a-4523-8c0f-d9c8adf17bb7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.217355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-ce79a18b-ddb2-412c-878b-66db154bd555 req-0673c033-3c1a-4523-8c0f-d9c8adf17bb7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.232773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-ce79a18b-ddb2-412c-878b-66db154bd555 req-0673c033-3c1a-4523-8c0f-d9c8adf17bb7 service nova] Creating event network-changed:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 16:57:11.238720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-ce79a18b-ddb2-412c-878b-66db154bd555 req-0673c033-3c1a-4523-8c0f-d9c8adf17bb7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050406 May 16 16:57:11.239606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 37/81] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:11.246422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:11.259530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3593a380-1690-42dc-ae5c-b00a5df7cf0a tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1314 microversion: 2.1 time: 0.308352 May 16 16:57:11.266964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 45/82] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:10 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:11.312292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:11.313090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:11.320036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.320659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.321567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.322169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.476957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:11.478004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:11.492218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.493117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.495822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.496290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.520942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:11.529288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:11.532933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:11.534470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7751d73b-f6b0-4311-83dd-ec80feae726a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.226698 May 16 16:57:11.535605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 38/83] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:11.681865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:11.699360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0634c11a-bb16-4374-9cc0-638522b361f5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.228480 May 16 16:57:11.700174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 46/84] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:11 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:11.714312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:11.715514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:11.726474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.727980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.728784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:11.729227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:11.939508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:11.952687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5db269dd-a6e7-414a-9c9a-4f3277855076 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.244002 May 16 16:57:11.954455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 39/85] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:12.279692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:12.280399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:12.295787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.295787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.295787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.295787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.536046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:12.549187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5466f119-7401-4d23-b2a0-b84793839585 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1501 microversion: 2.1 time: 0.272941 May 16 16:57:12.559406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:12.559406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:12.559710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.560320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.560491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 47/86] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:12 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1501 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:12.561540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.562019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.719461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:12.720166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:12.732955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:12.733543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.734022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.738048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.743383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.745028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:12.746748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:12.747995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3530f992-e527-40e9-b17d-b449ed4dcb51 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.199396 May 16 16:57:12.748727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 40/87] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:12.971368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:12.972633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:12.973365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:12.985984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.986776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b3c1a4e3-4eb8-4fcb-ac9d-91f3d009a262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.272054 May 16 16:57:12.987609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 48/88] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:12 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:12.989687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:12.992984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:12.993662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:13.267247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:13.276345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f53fd9c-3382-4d5e-ba69-ccdb91ac3a18 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.309562 May 16 16:57:13.277173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 41/89] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:13.765328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:13.766678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:13.773504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:13.774129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:13.775154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:13.775793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:13.920431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:13.929271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:13.931145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:13.932557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e2dcf0c4-92bc-4719-ab17-2674081ce2a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.171013 May 16 16:57:13.944843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 49/90] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:14.004580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:14.006301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:14.017133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.018634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.019465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.019905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.217206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "219e8c52-d2c3-4aa5-8fb4-f4185141a2d9"}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:14.218467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:14.226884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.227390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.228185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.228779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.251384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:14.263121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bd755761-1df4-4cd1-9636-693d85544eac tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1366 microversion: 2.1 time: 0.262487 May 16 16:57:14.264902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 42/91] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:13 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:14.294302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:14.295139 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:14.306242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.308226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.309214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.309865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.524203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:14.533281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0485180-9962-4497-8c77-7efa5ffe2b52 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.243448 May 16 16:57:14.534374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 43/92] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:14.800569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-07d9a261-df19-482f-a189-725d6bd2eb7d tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "POST /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587948 May 16 16:57:14.819607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 50/93] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 16:57:14 2022] POST /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba/os-volume_attachments => generated 194 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:57:14.952159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:14.952829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:14.962299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.965417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:14.967453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:14.968433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.281711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:15.289556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:15.294318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:15.298068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:15.299450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.300771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:15.301214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.306895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:15.308412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:15.309547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0c2ce91e-a464-49f3-b456-2d78e546d055 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.362369 May 16 16:57:15.318409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 44/94] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:15.478619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:15.497871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-131ce4ba-587a-4e1c-90f2-ce04dcc84ce0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1556 microversion: 2.1 time: 0.219397 May 16 16:57:15.498968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 51/95] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:15 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:15.515590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:15.516088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:15.522804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:15.523755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.524721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:15.525168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.551493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:15.553336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:15.565878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:15.566632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.568887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:15.569763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:15.681247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-da6a870f-0048-457b-977c-492ee9ec75f6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169784 May 16 16:57:15.682059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 45/96] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 16:57:15 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:15.826928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:15.834956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-53cf549d-4d75-4d50-8006-58eed4df14ca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.287255 May 16 16:57:15.835662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 52/97] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:16.335997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:16.337216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:16.343309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:16.343936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:16.344866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:16.345447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:16.544357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:16.553070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:16.554792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:16.556096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b2082704-6604-40aa-b11e-b0148653600d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.224573 May 16 16:57:16.557213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 46/98] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:16.855902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:16.857825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:16.886239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:16.888395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:16.890411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:16.893272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:17.123560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:17.136596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d009f2e8-5546-4a2d-a3ea-4483958f3283 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.286648 May 16 16:57:17.138538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 53/99] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:17.245177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-022b9e58-7c3a-4761-b3aa-89cbc2495e56 req-0229adab-39f0-422c-98be-669cb9fc4e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21efdaa-3bbe-4f8b-953d-6baaaadb9b53", "tag": "21ca2048-d933-4aa6-b313-3a05ab94f9bb"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:17.253984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-022b9e58-7c3a-4761-b3aa-89cbc2495e56 req-0229adab-39f0-422c-98be-669cb9fc4e30 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:17.255158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-022b9e58-7c3a-4761-b3aa-89cbc2495e56 req-0229adab-39f0-422c-98be-669cb9fc4e30 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:17.271361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-022b9e58-7c3a-4761-b3aa-89cbc2495e56 req-0229adab-39f0-422c-98be-669cb9fc4e30 service nova] Creating event network-changed:21ca2048-d933-4aa6-b313-3a05ab94f9bb for instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 on hv-cinder-83998 May 16 16:57:17.279929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-022b9e58-7c3a-4761-b3aa-89cbc2495e56 req-0229adab-39f0-422c-98be-669cb9fc4e30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039191 May 16 16:57:17.281239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 47/100] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:17.575222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:17.576109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:17.583528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:17.584215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:17.585142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:17.585723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:17.756207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:17.769053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:17.771136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:17.772417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f5c3013e-9811-468a-a727-0c19fc988970 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.201038 May 16 16:57:17.785528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 54/101] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:18.156523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:18.158144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:18.168523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:18.169357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:18.170670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:18.171364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:18.428395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:18.437231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-65a022f0-5db5-4c30-ad01-fbdb74e53a1f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.285529 May 16 16:57:18.447177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 48/102] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:18.790392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:18.791069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:18.800223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:18.802899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:18.804250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:18.806200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:19.040749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:19.055963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:19.057480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:19.058644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d2fed692-e830-4e2c-8c00-7e1286cf2821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.273036 May 16 16:57:19.070158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 55/103] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:19.458711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:19.459551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:19.466193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:19.466841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:19.467663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:19.468076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:19.629221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:19.640939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55be4789-7386-4cc9-a9b9-365dc911f01e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.189538 May 16 16:57:19.642058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 49/104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:20.085663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:20.086968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:20.093090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:20.094077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:20.095629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:20.096278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:20.287739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:20.309765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:20.316235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:20.319811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5a4cc7fe-c04c-4dc2-acf4-5a6e58a1666c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.242719 May 16 16:57:20.321635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 56/105] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:20.658783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:20.659910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:20.666498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:20.667134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:20.668053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:20.668503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:20.804754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:20.815371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7d38bfa7-9601-4bc0-ac89-3f22a52da50d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.160192 May 16 16:57:20.816352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 50/106] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:21.339697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:21.340312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:21.347392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:21.347779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:21.348612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:21.349065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:21.508834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:21.518646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:21.521012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:21.525011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4fc0b85e-a514-47ec-9acc-00f35d054683 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.186214 May 16 16:57:21.525583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 57/107] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:21.832439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:21.833251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:21.840128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:21.840873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:21.841711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:21.842350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:21.982777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:21.991949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e04b78a1-88b0-4359-aa16-8be0d729c6e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.163196 May 16 16:57:21.992594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 51/108] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:22.454717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-a7d96fc1-d137-4189-b0af-d79e7a227f17 req-f47105c9-fdb5-476b-9243-a85ba9218e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb86dab5-8d6b-4d24-969a-687c2224d48d", "name": "network-vif-plugged", "status": "completed", "tag": "0d2d13e9-d075-4dd0-a707-5f7669545169"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:22.472222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a7d96fc1-d137-4189-b0af-d79e7a227f17 req-f47105c9-fdb5-476b-9243-a85ba9218e2a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:22.475113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a7d96fc1-d137-4189-b0af-d79e7a227f17 req-f47105c9-fdb5-476b-9243-a85ba9218e2a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:22.496468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-a7d96fc1-d137-4189-b0af-d79e7a227f17 req-f47105c9-fdb5-476b-9243-a85ba9218e2a service nova] Creating event network-vif-plugged:0d2d13e9-d075-4dd0-a707-5f7669545169 for instance bb86dab5-8d6b-4d24-969a-687c2224d48d on hv-cinder-83998 May 16 16:57:22.505859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-a7d96fc1-d137-4189-b0af-d79e7a227f17 req-f47105c9-fdb5-476b-9243-a85ba9218e2a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054519 May 16 16:57:22.506492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 58/109] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:22.544811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:22.545751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:22.553787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:22.554525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:22.555771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:22.557301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:22.781909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:22.791218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:22.792784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:22.800660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-47d6aa46-6dc0-4ee0-9839-7f8d4b5d8912 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.254420 May 16 16:57:22.801334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 52/110] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:23.014760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:23.015536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:23.023372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:23.024292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:23.025450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:23.026236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:23.219206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:23.227975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1c58fb8b-9a9e-48d9-a74d-5c739e3fd4bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.218326 May 16 16:57:23.228570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 59/111] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:23.820727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:23.821463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:23.828418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:23.829182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:23.830344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:23.830780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:23.994185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:24.004081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:24.006942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:24.008921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-882934cf-053f-4785-be77-3d962eca8773 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.192522 May 16 16:57:24.010309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 53/112] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:24.245236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:24.246577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:24.253696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:24.254423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:24.255546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:24.256163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:24.462529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:24.471160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b2ca02e-9fe0-4655-a925-ade76df9d0c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.230429 May 16 16:57:24.472017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 60/113] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:24.529218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-deaddc27-ef18-446d-a132-be4ccdb02904 req-985a39c1-8e53-4b9b-bf88-afc0f4364350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "name": "network-vif-plugged", "status": "completed", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:24.537295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-deaddc27-ef18-446d-a132-be4ccdb02904 req-985a39c1-8e53-4b9b-bf88-afc0f4364350 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:24.538077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-deaddc27-ef18-446d-a132-be4ccdb02904 req-985a39c1-8e53-4b9b-bf88-afc0f4364350 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:24.554815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-deaddc27-ef18-446d-a132-be4ccdb02904 req-985a39c1-8e53-4b9b-bf88-afc0f4364350 service nova] Creating event network-vif-plugged:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 16:57:24.559742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-deaddc27-ef18-446d-a132-be4ccdb02904 req-985a39c1-8e53-4b9b-bf88-afc0f4364350 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034294 May 16 16:57:24.561106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 54/114] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:25.030076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:25.030697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:25.041528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:25.043653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:25.045246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:25.045689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:25.222855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:25.234130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:25.236220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:25.238673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d4fb09f-0141-4250-8b34-0d1bc70dc232 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.212150 May 16 16:57:25.240618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 61/115] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:25.494257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:25.495728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:25.502489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:25.503305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:25.505141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:25.505646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:25.661930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:25.670365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12b316cc-35bf-4f71-b6f5-52ce852cce5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.184303 May 16 16:57:25.671136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 55/116] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:26.258217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:26.258823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:26.265102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:26.265549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:26.266352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:26.266782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:26.421317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:26.430436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:26.432277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:26.433490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-474a5dc8-b290-4d7b-b136-8fbfe0694cdc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.179126 May 16 16:57:26.434365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 62/117] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:26.689795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:26.690961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:26.698031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:26.698739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:26.699989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:26.700967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:26.845023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:26.853062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0267c900-9669-4a61-80cc-acaded6b3b55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.168776 May 16 16:57:26.853535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 56/118] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:27.452028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:27.453008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:27.463838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:27.464306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:27.465087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:27.465533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:27.603308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:27.611278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:27.612771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:27.614497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d3b587d-d048-4a58-bd5d-3b59109dc1ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.165710 May 16 16:57:27.615069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 63/119] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:27.870270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:27.870891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:27.876733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:27.877185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:27.877993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:27.878435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:28.002461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:28.010192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9e2dbf85-9d14-4d96-a1ec-5f40f9dab936 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1363 microversion: 2.1 time: 0.143689 May 16 16:57:28.010765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 57/120] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:28.634044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:28.634748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:28.643027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:28.643772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:28.644748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:28.645965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:28.796115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:28.805349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:28.806884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:28.808008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6642bfd2-6c85-4a73-b2da-1cdb02e6f796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.179681 May 16 16:57:28.808568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 64/121] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:29.026925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:29.027543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:29.033496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:29.033988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:29.034762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:29.035206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:29.199036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:29.208001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b56ea8a4-c111-47bc-a2e6-68691dd7dc27 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1550 microversion: 2.1 time: 0.184139 May 16 16:57:29.208550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 58/122] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:29.224960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:29.225465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:29.231561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:29.232010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:29.232798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:29.233232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:29.306937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-09ad18d0-e6b2-4e0f-8de6-2706887d04b7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.085797 May 16 16:57:29.307543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 65/123] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 16:57:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:29.826056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:29.826661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:29.836222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:29.836683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:29.840327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:29.840837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:30.144646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:30.145253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:30.152078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:30.152590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:30.153403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:30.153864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:30.192710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 16:57:30.360730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-30a04a75-9aeb-48e3-87cb-a3f16ed8b4a6 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 204 len: 0 microversion: 2.1 time: 0.218912 May 16 16:57:30.369077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 66/124] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 16:57:30 2022] DELETE /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 16:57:30.383291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:30.385104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:30.395288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:30.396181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:30.397620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:30.398679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:30.518769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:30.527509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:30.529005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:30.530135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-40e3d237-5d3e-401b-b1af-38d2a6c1eb59 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.708693 May 16 16:57:30.533206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 59/125] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:30.592638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:30.602934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-47abb850-1549-4962-ba5f-e565cd3f1edd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.228117 May 16 16:57:30.614347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 67/126] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:30 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:31.033533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-c496059b-74bc-41dd-83e3-ee400286232f req-3113543f-45cf-4b5a-83ae-ffa4bcbd2ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb86dab5-8d6b-4d24-969a-687c2224d48d", "tag": "0d2d13e9-d075-4dd0-a707-5f7669545169"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:31.044430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-c496059b-74bc-41dd-83e3-ee400286232f req-3113543f-45cf-4b5a-83ae-ffa4bcbd2ea8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:31.045158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-c496059b-74bc-41dd-83e3-ee400286232f req-3113543f-45cf-4b5a-83ae-ffa4bcbd2ea8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:31.057258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-c496059b-74bc-41dd-83e3-ee400286232f req-3113543f-45cf-4b5a-83ae-ffa4bcbd2ea8 service nova] Creating event network-changed:0d2d13e9-d075-4dd0-a707-5f7669545169 for instance bb86dab5-8d6b-4d24-969a-687c2224d48d on hv-cinder-83998 May 16 16:57:31.063421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-c496059b-74bc-41dd-83e3-ee400286232f req-3113543f-45cf-4b5a-83ae-ffa4bcbd2ea8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037113 May 16 16:57:31.068429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 60/127] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:31.550598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:31.551766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:31.564626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:31.565089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:31.565908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:31.566602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:31.621222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:31.622070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:31.628609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:31.634895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:31.636267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:31.637061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:31.768228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:31.784489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:31.786794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:31.791618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:31.792806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a167add3-1447-48cb-b223-2895c0d98c60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.246122 May 16 16:57:31.792938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4cdc3065-e97e-4180-aa84-d3f6ca543971 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.175776 May 16 16:57:31.793459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 61/128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:31 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:31.805924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 68/129] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:32.817466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:32.818163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:32.820866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:32.821478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:32.824371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:32.824822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:32.825592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:32.826054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:32.827313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:32.827753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:32.828504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:32.828926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:32.955149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:32.956180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:32.963490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:32.964259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ff06a91d-c607-436c-a3bc-2ca177d0996c tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.147633 May 16 16:57:32.964829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 62/130] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:32 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:57:32.964981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:32.966121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ca6d0f81-aeab-4102-925e-513e54d17fbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.153140 May 16 16:57:32.966685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 69/131] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:33.982332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:33.983260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:33.984662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:33.985159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:33.991121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:33.991563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:33.992352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:33.992789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:33.993277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:33.993769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:33.994549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:33.994985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:34.128363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:34.139261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-189e25b6-df3e-4a05-b6d3-e636332503be tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.160338 May 16 16:57:34.140086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 63/132] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:33 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:34.148945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:34.158460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:34.160072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:34.165185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1154a815-8a23-4565-b643-ad591b192f63 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.184727 May 16 16:57:34.169806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 70/133] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:35.157707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:35.158420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:35.165504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:35.166032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:35.166807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:35.167226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:35.184173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:35.185366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:35.192469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:35.193055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:35.193946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:35.194466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:35.352247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:35.360982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f59e594a-163d-4dc4-a3c5-c8a25b2370b7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.207369 May 16 16:57:35.361775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 64/134] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:35 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:35.384891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:35.394555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:35.396199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:35.397540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fa197dd7-17a2-49b7-8ea4-0354fd048f01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.217175 May 16 16:57:35.398139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 71/135] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:36.377726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:36.378387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:36.384187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:36.384693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:36.385452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:36.385918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:36.416468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:36.417599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:36.423831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:36.424373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:36.425207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:36.425709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:36.520192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:36.528188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-03efbc60-f136-4fcb-bd08-a09ded5c34da tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.154197 May 16 16:57:36.529088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 65/136] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:36 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:36.559963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:36.568245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:36.569759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:36.570866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-93fc2925-be0d-4570-8ea3-f1a94ed1db5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.158229 May 16 16:57:36.571433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 72/137] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:37.545436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:37.546002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:37.552497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:37.552948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:37.553714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:37.554176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:37.588810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:37.589422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:37.596022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:37.596472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:37.597243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:37.598197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:37.681401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:37.689243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e67def18-0703-40f5-9740-a46f2a53b0eb tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.147685 May 16 16:57:37.689827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 66/138] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:37 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:37.726053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:37.733660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:37.735175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:37.736279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0a1e0d28-c8fb-491c-8499-d3f157c4d4ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.151281 May 16 16:57:37.736842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 73/139] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:38.706401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:38.707517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:38.713418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:38.713897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:38.714663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:38.715100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:38.753985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:38.754710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:38.761474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:38.762032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:38.762807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:38.763242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:38.848606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:38.856698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4efd9020-3b6c-4d86-acb0-7ca71e55b8f3 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.154168 May 16 16:57:38.857271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 67/140] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:38 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:38.901160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:38.908995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:38.910590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:38.911707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c3c3f33a-d1bf-4cdb-99d1-63ea375c1bf9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.161645 May 16 16:57:38.912275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 74/141] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:39.874044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:39.882875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:39.882875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:39.882875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:39.882875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:39.883562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:39.930362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:39.930972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:39.937163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:39.937611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:39.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:39.938845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:40.009010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:40.016846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-28ad7b35-a535-413d-89be-146143bdfaee tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.146715 May 16 16:57:40.017718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 68/142] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:39 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:40.066739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:40.074350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:40.075940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:40.077089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-73668667-80c7-489f-ab73-14c65571a159 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.151144 May 16 16:57:40.077647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 75/143] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:41.034963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:41.036152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:41.042109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:41.042563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:41.043326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:41.043759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:41.096776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:41.097566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:41.107609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:41.108056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:41.108831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:41.109264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:41.171798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:41.179765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ca33b64a-d7b7-4291-bf66-d9c697d1407b tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.148708 May 16 16:57:41.180482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 69/144] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:41 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:41.240675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:41.248434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:41.249962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:41.251066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8b4401be-5af3-4499-aea3-dfc1cac1f1de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1407 microversion: 2.20 time: 0.159335 May 16 16:57:41.251634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 76/145] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:57:42.202155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:42.202958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:42.211236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:42.211707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:42.212478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:42.212917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:42.269156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:42.270412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:42.277095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:42.278006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:42.279058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:42.279566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:42.367207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:42.379027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6d1a4618-e290-4aee-b969-612da66e7747 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1553 microversion: 2.1 time: 0.181621 May 16 16:57:42.379812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 70/146] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:42 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:42.421093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:42.429864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:42.431363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:42.432553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2e813eb5-137f-4e1f-a6d1-113d97e71e4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1600 microversion: 2.20 time: 0.167517 May 16 16:57:42.433117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 77/147] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:57:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:57:42.451019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:42.453049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:42.462090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:42.462537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:42.463321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:42.463753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:42.562925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-558e6381-1b5a-4e4d-afd4-b1aad259a14d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115728 May 16 16:57:42.563874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 71/148] 10.222.0.70 () {60 vars in 1315 bytes} [Mon May 16 16:57:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:57:43.396691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:43.398582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:43.411089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:43.419590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:43.420690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:43.421840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:43.498235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-aa396845-be9b-4cc3-a278-2df47c42085a req-d71cf443-0281-45a9-9722-a9a1883e1e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4300ecf-816f-4b04-9586-2b819465b7ba", "name": "network-vif-deleted", "tag": "0160d46d-ef6c-4b39-9f84-ef4e81166f59"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:43.510604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-aa396845-be9b-4cc3-a278-2df47c42085a req-d71cf443-0281-45a9-9722-a9a1883e1e59 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:43.511068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-aa396845-be9b-4cc3-a278-2df47c42085a req-d71cf443-0281-45a9-9722-a9a1883e1e59 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:43.513262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:43.524426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-aa396845-be9b-4cc3-a278-2df47c42085a req-d71cf443-0281-45a9-9722-a9a1883e1e59 service nova] Creating event network-vif-deleted:0160d46d-ef6c-4b39-9f84-ef4e81166f59 for instance e4300ecf-816f-4b04-9586-2b819465b7ba on hv-cinder-83998 May 16 16:57:43.525924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2127ed42-f703-471f-acec-b73dbc3b5952 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1511 microversion: 2.1 time: 0.133260 May 16 16:57:43.527572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 78/149] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:43 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1511 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:43.531864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-aa396845-be9b-4cc3-a278-2df47c42085a req-d71cf443-0281-45a9-9722-a9a1883e1e59 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037561 May 16 16:57:43.532482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 72/150] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:57:44.209049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-5b3b7d3d-2c4f-4af2-a240-407861371eac req-372a0970-1710-4f9b-b366-ae54babb38a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:44.218365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-5b3b7d3d-2c4f-4af2-a240-407861371eac req-372a0970-1710-4f9b-b366-ae54babb38a6 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:44.218808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-5b3b7d3d-2c4f-4af2-a240-407861371eac req-372a0970-1710-4f9b-b366-ae54babb38a6 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:44.234343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-5b3b7d3d-2c4f-4af2-a240-407861371eac req-372a0970-1710-4f9b-b366-ae54babb38a6 service nova] Creating event network-changed:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 16:57:44.256475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-5b3b7d3d-2c4f-4af2-a240-407861371eac req-372a0970-1710-4f9b-b366-ae54babb38a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037623 May 16 16:57:44.257145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 79/151] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:44.547771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:44.548585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:44.555620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:44.556274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:44.557227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:44.557668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:44.590668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:44.591115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:44.591580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lazy-loading 'fault' on Instance uuid e4300ecf-816f-4b04-9586-2b819465b7ba {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:57:44.654743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe14bbc5f34432882bf74de0536ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a145ae754d55458792b86bdda0ceb304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:44.664578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-77f846da-aacb-4307-b5e0-44866041e7cd tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 200 len: 1350 microversion: 2.1 time: 0.122022 May 16 16:57:44.665369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 73/152] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:44 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:45.684106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:45.684867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:45.691219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:45.691671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:45.692651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:45.693242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:45.709196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] HTTP exception thrown: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Request method failure captured: May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba HTTP/1.1 May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJApH28uiLvW-QfM6-meJ-8m9o3_Ia_s38-FCeRdkenUrDncLFATDU-i7VlU152FR6OsHvQEdAeeTTFSEx8TUwhXvQ0V_9lg_ZZ1gp71rfmqPDZORXFapuBUK5we-8AY6uLUDkU3pJweRGFHGlsoygKdOhlpGGZWiFqBvdkZiTLOVg May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:57:45.714009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a145ae754d55458792b86bdda0ceb304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-DeleteServersTestJSON-546633567 May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 0cfe14bbc5f34432882bf74de0536ab4 May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.715405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'e4300ecf-816f-4b04-9586-2b819465b7ba'} May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:57:45.716159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.717361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:45.718706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Returning 404 to user: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:57:45.718706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6cce0561-517a-4556-bbce-629111ba1d75 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 404 len: 111 microversion: 2.1 time: 0.036507 May 16 16:57:45.718706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 80/153] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:45 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:57:45.829994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:45.831589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:45.838430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:45.839065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:45.839992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:45.840430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:45.854091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] HTTP exception thrown: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Request method failure captured: May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba/os-volume_attachments HTTP/1.1 May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJApH28uiLvW-QfM6-meJ-8m9o3_Ia_s38-FCeRdkenUrDncLFATDU-i7VlU152FR6OsHvQEdAeeTTFSEx8TUwhXvQ0V_9lg_ZZ1gp71rfmqPDZORXFapuBUK5we-8AY6uLUDkU3pJweRGFHGlsoygKdOhlpGGZWiFqBvdkZiTLOVg May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 16:57:45.859039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a145ae754d55458792b86bdda0ceb304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-DeleteServersTestJSON-546633567 May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 0cfe14bbc5f34432882bf74de0536ab4 May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.860454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'server_id': 'e4300ecf-816f-4b04-9586-2b819465b7ba'} May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:57:45.861249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:45.862437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:45.863501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Returning 404 to user: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:57:45.863501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4f48771a-e138-40c9-95fd-db8bc59fa648 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035228 May 16 16:57:45.863501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 74/154] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 16:57:45 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:57:47.053150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:47.053631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:47.060102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:47.060497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:47.061445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:47.061911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:47.079244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] HTTP exception thrown: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Request method failure captured: May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba HTTP/1.1 May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJApH28uiLvW-QfM6-meJ-8m9o3_Ia_s38-FCeRdkenUrDncLFATDU-i7VlU152FR6OsHvQEdAeeTTFSEx8TUwhXvQ0V_9lg_ZZ1gp71rfmqPDZORXFapuBUK5we-8AY6uLUDkU3pJweRGFHGlsoygKdOhlpGGZWiFqBvdkZiTLOVg May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:57:47.081080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a145ae754d55458792b86bdda0ceb304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-DeleteServersTestJSON-546633567 May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 0cfe14bbc5f34432882bf74de0536ab4 May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.083078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'e4300ecf-816f-4b04-9586-2b819465b7ba'} May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:57:47.083716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.084793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:57:47.086771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Returning 404 to user: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:57:47.087767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1a6190f6-39b9-415c-84cc-8857f8ce7ac7 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 404 len: 111 microversion: 2.1 time: 0.038492 May 16 16:57:47.088994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 81/155] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 16:57:47 2022] DELETE /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:57:47.096692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:47.097345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] [instance: e4300ecf-816f-4b04-9586-2b819465b7ba] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:47.104906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:47.105560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:47.106748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:47.107381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:47.122638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] HTTP exception thrown: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Request method failure captured: May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba HTTP/1.1 May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJApH28uiLvW-QfM6-meJ-8m9o3_Ia_s38-FCeRdkenUrDncLFATDU-i7VlU152FR6OsHvQEdAeeTTFSEx8TUwhXvQ0V_9lg_ZZ1gp71rfmqPDZORXFapuBUK5we-8AY6uLUDkU3pJweRGFHGlsoygKdOhlpGGZWiFqBvdkZiTLOVg May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 16:57:47.124997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a145ae754d55458792b86bdda0ceb304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a145ae754d55458792b86bdda0ceb304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-DeleteServersTestJSON-546633567 May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: a145ae754d55458792b86bdda0ceb304 May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-DeleteServersTestJSON-546633567 May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 0cfe14bbc5f34432882bf74de0536ab4 May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-DeleteServersTestJSON-546633567-project May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.126393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'e4300ecf-816f-4b04-9586-2b819465b7ba'} May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:57:47.127225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. May 16 16:57:47.128416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:57:47.131388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] Returning 404 to user: Instance e4300ecf-816f-4b04-9586-2b819465b7ba could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:57:47.132415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e0005907-a053-4e89-a6e9-4296ebaf2ce4 tempest-DeleteServersTestJSON-546633567 tempest-DeleteServersTestJSON-546633567-project] 10.222.0.70 "GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba" status: 404 len: 111 microversion: 2.1 time: 0.039803 May 16 16:57:47.133175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 75/156] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:47 2022] GET /compute/v2.1/servers/e4300ecf-816f-4b04-9586-2b819465b7ba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:57:57.392242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-597265813", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:57.498109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] validate_networks() for [('9e644bf2-f482-4573-8a81-7be8b637b410', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:57:58.469131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:57:58.469967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:57:58.470470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:57:58.470940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:57:58.472530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:57:58.483860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:58.484473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:58.485367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:58.485943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:58.505070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for project d288b61a6379415c9f773fc61950f570. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:57:58.509453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for user 673ff42fb9454adf93be94f46e60755a and project d288b61a6379415c9f773fc61950f570. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:57:58.543227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:57:58.548269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:57:58.625986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b9ebb51e-6937-401c-8686-4534ab78b890 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.435423 May 16 16:57:58.627237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 82/157] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:57:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 16:57:58.638474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-acaf74ef-9be4-47f1-87a7-ee50be3562a1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:58.643814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-acaf74ef-9be4-47f1-87a7-ee50be3562a1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:58.720525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-acaf74ef-9be4-47f1-87a7-ee50be3562a1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:58.728233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-acaf74ef-9be4-47f1-87a7-ee50be3562a1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1221 microversion: 2.1 time: 0.094782 May 16 16:57:58.728820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 76/158] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:58 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:57:58.819956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1599713568", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:58.901732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] validate_networks() for [('9e644bf2-f482-4573-8a81-7be8b637b410', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:57:59.568420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:57:59.569053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:57:59.569559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:57:59.570120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:57:59.570607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:57:59.583600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:59.584333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:59.585485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:57:59.586121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:57:59.594636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5a3a7d58-7bc9-4d95-9154-b34cc404f8fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Action: 'create', calling method: .version_select at 0x7feace4303a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-327983792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTWJKRTNgICT1hZv9ALTzGjSlij8jZX6QNUTwymP02Bw8HxkOtAtVr6pL5tWF2dOBx1fqJ33Cco2JY5FW493PXot9g6rNCEyMwIbX5Q2z84koVp8Bc0zuiA1boM+CJnWA=="}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:57:59.620163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-5a3a7d58-7bc9-4d95-9154-b34cc404f8fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Getting quotas for project 55fbe5576de844559b26175408f40f3f. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:57:59.626331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-5a3a7d58-7bc9-4d95-9154-b34cc404f8fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Getting quotas for user e0f8b3570fb544c7be48b4bc3401e780 and project 55fbe5576de844559b26175408f40f3f. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:57:59.646925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for project d288b61a6379415c9f773fc61950f570. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:57:59.655976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for user 673ff42fb9454adf93be94f46e60755a and project d288b61a6379415c9f773fc61950f570. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:57:59.670397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5a3a7d58-7bc9-4d95-9154-b34cc404f8fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.324827 May 16 16:57:59.673208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 77/159] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 16:57:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:57:59.692143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:57:59.697250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:57:59.816506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eb5b9e7e-d034-4ddc-8c57-ac0057642ad9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.001238 May 16 16:57:59.820933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 83/160] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:57:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:57:59.832468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-57c37f43-c772-4eea-b4bd-3e6c2d0a2b5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:57:59.833395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-57c37f43-c772-4eea-b4bd-3e6c2d0a2b5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:57:59.950282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-57c37f43-c772-4eea-b4bd-3e6c2d0a2b5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:57:59.960581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-57c37f43-c772-4eea-b4bd-3e6c2d0a2b5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1222 microversion: 2.1 time: 0.133946 May 16 16:57:59.969857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 78/161] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:57:59 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:00.993500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:00.994315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:01.006516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:01.008461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:01.009847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:01.012144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:01.209478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:01.221512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a2680d01-8218-497a-be61-14275fb111e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1218 microversion: 2.1 time: 0.238203 May 16 16:58:01.224874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 84/162] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:00 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:02.241286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:02.243532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:02.268520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:02.270647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:02.271475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:02.275956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:02.469058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:02.518617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-630362d8-6b3d-45cf-99b3-424aaa945da7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1282 microversion: 2.1 time: 0.257532 May 16 16:58:02.544833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 79/163] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:02 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:03.537227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:03.537887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:03.557725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:03.558204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:03.558991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:03.559426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:04.432001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-5373a768-05b5-43b2-85a7-ccae52016d06 req-cceacc62-2ab9-45ee-8064-bb2ced69ed6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511490fe-b0f9-40b5-ac21-4ca092e7e4ee", "tag": "9478ec5c-7ce9-40dc-985e-b830b8e9bba3"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:04.444747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5373a768-05b5-43b2-85a7-ccae52016d06 req-cceacc62-2ab9-45ee-8064-bb2ced69ed6d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:04.445587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5373a768-05b5-43b2-85a7-ccae52016d06 req-cceacc62-2ab9-45ee-8064-bb2ced69ed6d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:04.462366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-5373a768-05b5-43b2-85a7-ccae52016d06 req-cceacc62-2ab9-45ee-8064-bb2ced69ed6d service nova] Creating event network-changed:9478ec5c-7ce9-40dc-985e-b830b8e9bba3 for instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee on hv-cinder-83998 May 16 16:58:04.469596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-5373a768-05b5-43b2-85a7-ccae52016d06 req-cceacc62-2ab9-45ee-8064-bb2ced69ed6d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049351 May 16 16:58:04.475941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 80/164] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:58:04.660375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:04.667963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5e8fda23-c7e2-4d2c-948a-21299e9d91f4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 1.135236 May 16 16:58:04.669095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 85/165] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:03 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:05.242081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-dbc86511-553e-4cf8-8244-0d266bfd4f51 req-31d62588-771b-4c11-aad0-901fe82cf0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bded9a-8c44-4952-b4c6-77411db4c88b", "tag": "1daf69b4-5c81-495d-8d47-d9a0bd00e8b4"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:05.263063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-dbc86511-553e-4cf8-8244-0d266bfd4f51 req-31d62588-771b-4c11-aad0-901fe82cf0f7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:05.264082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-dbc86511-553e-4cf8-8244-0d266bfd4f51 req-31d62588-771b-4c11-aad0-901fe82cf0f7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:05.290548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-dbc86511-553e-4cf8-8244-0d266bfd4f51 req-31d62588-771b-4c11-aad0-901fe82cf0f7 service nova] Creating event network-changed:1daf69b4-5c81-495d-8d47-d9a0bd00e8b4 for instance d7bded9a-8c44-4952-b4c6-77411db4c88b on hv-cinder-83998 May 16 16:58:05.304266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-dbc86511-553e-4cf8-8244-0d266bfd4f51 req-31d62588-771b-4c11-aad0-901fe82cf0f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069608 May 16 16:58:05.305017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 81/166] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:05.685998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:05.686546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:05.692869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:05.693324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:05.694158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:05.694596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:05.833303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:05.840616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-48ed1826-2ef5-4fe4-899e-36d14922d207 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.158658 May 16 16:58:05.841179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 86/167] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:05 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:06.858116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:06.860201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:06.867024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:06.867943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:06.869019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:06.869464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:07.010116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:07.017951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3cc3ac4d-b96b-48ea-a090-b873e45c22b9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.164056 May 16 16:58:07.019182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 82/168] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:06 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:08.036414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:08.037026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:08.043413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:08.043859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:08.044630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:08.045065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:08.181196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:08.188398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-577568de-f422-4b39-ad0f-7d2017a39b72 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.156487 May 16 16:58:08.188913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 87/169] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:08 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:09.204402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:09.205231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:09.213502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:09.214357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:09.215472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:09.216026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:09.385630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:09.394732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e47e174-4689-4e36-a265-2957d252426f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.194180 May 16 16:58:09.395926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 83/170] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:09 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:10.415328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:10.416607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:10.426781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:10.427329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:10.428223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:10.428669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:10.559448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:10.568215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-72d71a99-1703-487c-8d26-030c46a9b3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.159489 May 16 16:58:10.577899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 88/171] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:10 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:11.584842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:11.585457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:11.591363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:11.591809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:11.592564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:11.592995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:11.718525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:11.726237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9994f109-86d7-4ee5-a0a5-6f4c4392061a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.145109 May 16 16:58:11.726805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 84/172] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:11 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:12.742733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:12.743360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:12.749684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:12.750164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:12.750927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:12.751365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:12.884492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:12.891910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-03c07e65-1f3c-4fe9-9628-b41197d10ffd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.153013 May 16 16:58:12.892541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 89/173] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:12 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:13.353010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:13.353565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:13.359305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:13.359754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:13.360520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:13.360958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:13.387228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a6504e02-e13f-40f5-a07a-cc77c387de2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/ips" status: 200 len: 150 microversion: 2.1 time: 0.037972 May 16 16:58:13.389834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 85/174] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 16:58:13 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:13.908363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:13.909670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:13.916124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:13.917202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:13.918016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:13.918461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:14.115850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:14.125799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a24b5c14-2dda-4de8-8515-97639d5b3bd6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.221213 May 16 16:58:14.133917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 90/175] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:13 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:14.768303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a2a1ae1-fb34-495d-b16b-55202813542d"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:14.769491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:14.775837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:14.776296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:14.777079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:14.777516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:15.055630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-66e5ac4c-8a5f-4260-84da-c149d1dd467e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291137 May 16 16:58:15.056468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 86/176] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 16:58:14 2022] POST /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:15.142656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:15.143350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:15.149403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:15.149905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:15.150675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:15.151104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:15.303082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:15.310873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0a2bc9ec-87ef-4272-b0d1-dea51af4ba79 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.172310 May 16 16:58:15.312326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 91/177] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:15 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:15.505055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-2fe75c96-e434-4652-bc28-eb660cdd1d59 req-fb340fc2-0750-4906-b5b9-897e058c57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511490fe-b0f9-40b5-ac21-4ca092e7e4ee", "name": "network-vif-plugged", "status": "completed", "tag": "9478ec5c-7ce9-40dc-985e-b830b8e9bba3"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:15.515807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-2fe75c96-e434-4652-bc28-eb660cdd1d59 req-fb340fc2-0750-4906-b5b9-897e058c57d1 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:15.516538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-2fe75c96-e434-4652-bc28-eb660cdd1d59 req-fb340fc2-0750-4906-b5b9-897e058c57d1 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:15.530476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-2fe75c96-e434-4652-bc28-eb660cdd1d59 req-fb340fc2-0750-4906-b5b9-897e058c57d1 service nova] Creating event network-vif-plugged:9478ec5c-7ce9-40dc-985e-b830b8e9bba3 for instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee on hv-cinder-83998 May 16 16:58:15.536376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-2fe75c96-e434-4652-bc28-eb660cdd1d59 req-fb340fc2-0750-4906-b5b9-897e058c57d1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037763 May 16 16:58:15.536992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 87/178] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:16.328117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:16.328745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:16.336341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:16.336804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:16.337553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:16.338021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:16.481320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:16.488966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-47b870a8-de38-4020-864e-b278370fc738 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.164719 May 16 16:58:16.489547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 92/179] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:16 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:17.507523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:17.508313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:17.515606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:17.516635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:17.517522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:17.518291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:17.571394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-6939805e-cda5-434e-8207-75c1889b50dc req-fda11b5e-4462-4a27-a5ff-3a34d0c7e0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bded9a-8c44-4952-b4c6-77411db4c88b", "name": "network-vif-plugged", "status": "completed", "tag": "1daf69b4-5c81-495d-8d47-d9a0bd00e8b4"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:17.619944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-6939805e-cda5-434e-8207-75c1889b50dc req-fda11b5e-4462-4a27-a5ff-3a34d0c7e0fb service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:17.625874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-6939805e-cda5-434e-8207-75c1889b50dc req-fda11b5e-4462-4a27-a5ff-3a34d0c7e0fb service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:17.647542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-6939805e-cda5-434e-8207-75c1889b50dc req-fda11b5e-4462-4a27-a5ff-3a34d0c7e0fb service nova] Creating event network-vif-plugged:1daf69b4-5c81-495d-8d47-d9a0bd00e8b4 for instance d7bded9a-8c44-4952-b4c6-77411db4c88b on hv-cinder-83998 May 16 16:58:17.658189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-6939805e-cda5-434e-8207-75c1889b50dc req-fda11b5e-4462-4a27-a5ff-3a34d0c7e0fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090077 May 16 16:58:17.660572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 93/180] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:17.712910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:17.726875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b642543a-4d6e-4d7d-b566-7d1802e90e33 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.224098 May 16 16:58:17.728013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 88/181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:17 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:18.748662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:18.749495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:18.757114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:18.757850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:18.758823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:18.759252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:18.920991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:18.928983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-956f0a68-09aa-4823-bf15-2bc7f255cb3a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1322 microversion: 2.1 time: 0.188111 May 16 16:58:18.929570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 94/182] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:18 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:19.946964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:19.947537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:19.957758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:19.958576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:19.959461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:19.959839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:20.131395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:20.138841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1d141d54-5487-4342-a056-dfafbf2dd52b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1516 microversion: 2.1 time: 0.196040 May 16 16:58:20.139417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 89/183] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:19 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:20.155051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:20.155996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:20.162761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:20.163213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:20.163976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:20.164416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:20.186944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lazy-loading 'flavor' on Instance uuid d7bded9a-8c44-4952-b4c6-77411db4c88b {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:58:20.291778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aa53e33c-0109-4b00-87b2-6c4deba60212 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b/action" status: 200 len: 32 microversion: 2.1 time: 0.140693 May 16 16:58:20.292524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 95/184] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 16:58:20 2022] POST /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 16:58:20.303548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:20.304374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:20.311623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:20.312160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:20.313121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:20.313597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:20.459796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:20.467782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ee2717c4-f183-4140-a399-03c5d1d0200a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.169427 May 16 16:58:20.468356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 90/185] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:20 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:21.485710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:21.486428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:21.493019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:21.493470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:21.494260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:21.494698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:21.658674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:21.667021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ebb7d307-1fee-474b-a83e-dcbfc2b4cc78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.185814 May 16 16:58:21.667505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 96/186] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:21 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:22.684942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:22.685466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:22.692564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:22.693002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:22.693796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:22.694235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:22.823959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:22.831231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-81538ba2-1f72-40bf-a127-025d94d26945 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.150413 May 16 16:58:22.831805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 91/187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:22 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:23.848185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:23.848800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:23.856191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:23.856729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:23.857628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:23.858100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:23.984865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:23.992249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-52019ac2-e89f-46bd-b7ef-f59114692529 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.148563 May 16 16:58:23.992826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 97/188] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:23 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:24.689184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-20fdc538-6f7a-4203-b723-1b58cfab1d89 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: .version_select at 0x7feace3c8e50>, body: {"keypair": {"name": "tempest-keypair-477017817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL+S/hgjE5JZkxkFll1KEq541GevSe1044bTV8hd4hwYVG1/wRap79ZtQG+OvYfwZIjXxp+XCrsubkg5Yiv3H2EjM5iMrNkZ7Wz2k5o3vXzdh/pC4a6N7GcD+BUBUV0DA=="}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:24.705702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-20fdc538-6f7a-4203-b723-1b58cfab1d89 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:58:24.711484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-20fdc538-6f7a-4203-b723-1b58cfab1d89 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:58:24.736908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-20fdc538-6f7a-4203-b723-1b58cfab1d89 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051494 May 16 16:58:24.737634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 92/189] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 16:58:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:25.010080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:25.010693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:25.017450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:25.017818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:25.018644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:25.019018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:25.191276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:25.198729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6aff0534-53c8-47e1-bb66-a16a0a0367ff tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.192777 May 16 16:58:25.199527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 98/190] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:25 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:26.081920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-709963332", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b"}], "security_groups": [{"name": "tempest-securitygroup--133386954"}], "key_name": "tempest-keypair-477017817", "user_data": "}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:26.179940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] validate_networks() for [('6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:58:26.216303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:26.216919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:26.223153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:26.224112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:26.225132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:26.225569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:26.352332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:26.359582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-42c1f485-6699-4160-a6e2-d7957dafb643 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.147163 May 16 16:58:26.360368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 99/191] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:26 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:26.539259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:58:26.539683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:58:26.540152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:58:26.540558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:58:26.540986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:58:26.549459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:26.549941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:26.550732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:26.551163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:26.567555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:58:26.571573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:58:26.582671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:58:26.585438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:58:26.630993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76de8904-992b-4ead-9362-a5a13962b778 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.553588 May 16 16:58:26.631644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 93/192] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:58:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 16:58:26.641714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-76367389-7923-4b18-8cbe-449ac70c1d6b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:26.642425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-76367389-7923-4b18-8cbe-449ac70c1d6b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:26.710138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76367389-7923-4b18-8cbe-449ac70c1d6b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:26.716887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-76367389-7923-4b18-8cbe-449ac70c1d6b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1240 microversion: 2.1 time: 0.079048 May 16 16:58:26.717475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 100/193] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:26 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:27.376926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:27.377597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:27.384624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:27.385074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:27.385871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:27.386312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:27.514685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:27.522516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dc793b12-5f50-400e-b632-9b439a39589a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.149448 May 16 16:58:27.523092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 94/194] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:27 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:27.733856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:27.734473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:27.741306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:27.741767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:27.742546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:27.742977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:27.803242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:27.810399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2f937f78-f262-49a4-84e1-ba81052358ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1236 microversion: 2.1 time: 0.080364 May 16 16:58:27.811004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 101/195] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:27 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:28.539859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:28.540474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:28.547405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:28.547859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:28.548640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:28.549074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:28.680375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:28.688499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-598963dc-2889-4285-abd5-6df9240716f0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.153601 May 16 16:58:28.689565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 95/196] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:28 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:28.827315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:28.828142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:28.835130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:28.835568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:28.836346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:28.836776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:28.927832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:28.935616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6dcecf16-7ba8-4047-bdf1-ae8613b2c588 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1298 microversion: 2.1 time: 0.111901 May 16 16:58:28.936139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 102/197] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:28 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:29.707091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:29.707760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:29.715880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:29.716390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:29.718252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:29.719244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:29.847726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-21b24cf7-93b5-43ed-afc7-96f51309ebe2 req-114928c1-a533-4c5c-89fa-08d7430d9489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33c9ac7f-ecb0-453c-91c2-191f32b2958d", "tag": "d27e0ff3-d6c6-4dd0-9992-12170feea445"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:29.858415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-21b24cf7-93b5-43ed-afc7-96f51309ebe2 req-114928c1-a533-4c5c-89fa-08d7430d9489 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:29.859258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-21b24cf7-93b5-43ed-afc7-96f51309ebe2 req-114928c1-a533-4c5c-89fa-08d7430d9489 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:29.875962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:29.889257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e9afd2a-71b5-415c-8466-0e8f83cf571a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.186974 May 16 16:58:29.890705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 96/198] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:29 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:29.894002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-21b24cf7-93b5-43ed-afc7-96f51309ebe2 req-114928c1-a533-4c5c-89fa-08d7430d9489 service nova] Creating event network-changed:d27e0ff3-d6c6-4dd0-9992-12170feea445 for instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d on hv-cinder-83998 May 16 16:58:29.899970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-21b24cf7-93b5-43ed-afc7-96f51309ebe2 req-114928c1-a533-4c5c-89fa-08d7430d9489 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055749 May 16 16:58:29.900666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 103/199] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:58:29.952659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:29.953280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:29.960044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:29.960502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:29.961288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:29.961728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:30.115056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:30.122396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cc035fe4-2a58-4846-9b58-c918a8c3d392 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.173647 May 16 16:58:30.123096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 97/200] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:29 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:30.911982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:30.912786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:30.919830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:30.920284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:30.921284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:30.921783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:31.071410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:31.078689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c7787e27-f0f7-458a-a290-ceed2f0b2eae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.174050 May 16 16:58:31.079262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 104/201] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:30 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:31.139638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:31.140249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:31.146510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:31.146957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:31.147724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:31.148153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:31.280564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:31.287818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-63c352a5-c34b-4220-b3ec-6c99b20b605e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.152041 May 16 16:58:31.288403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 98/202] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:31 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:32.095635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:32.096251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:32.103502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:32.103953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:32.104934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:32.105371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:32.304819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:32.306157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:32.312548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:32.312993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:32.313760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:32.314192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:32.332460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:32.342675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-93ee323e-08f9-4f8d-8ae8-e46cb76e49ea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.249977 May 16 16:58:32.350138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 105/203] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:32 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:32.586011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:32.593188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-030205cf-5775-4e51-86ee-1d0d2b8d1c93 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.292782 May 16 16:58:32.593835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 99/204] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:32 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:33.360166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:33.360776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:33.367573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:33.368025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:33.368784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:33.369219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:33.498994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:33.506782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d1c65902-b7d6-4c71-9e9b-88351ed45c91 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.150446 May 16 16:58:33.507356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 106/205] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:33 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:33.610834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:33.611439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:33.618421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:33.618870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:33.619629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:33.620060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:33.743440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:33.750647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-284f91e9-e5bb-485c-a4c6-e7b065227f9e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.143554 May 16 16:58:33.751152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 100/206] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:33 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:34.524448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:34.525119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:34.531392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:34.531837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:34.532619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:34.533050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:34.657648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:34.665038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2dfcf7e9-842b-47e0-94b6-ee5dd92aef73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.145090 May 16 16:58:34.665621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 107/207] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:34 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:34.766938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:34.767527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:34.774018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:34.774512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:34.775217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:34.775651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:34.905533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:34.912928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-918da999-3693-4732-b2bf-6ed57173adc6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.149857 May 16 16:58:34.913492 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 101/208] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:34 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:35.681814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:35.682425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:35.689226 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:35.689665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:35.690442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:35.690869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:35.819522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:35.826891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea71cf19-5417-4657-ba73-a020f7327d4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.148960 May 16 16:58:35.827472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 108/209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:35 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:35.930241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:35.933176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:35.940128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:35.940628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:35.941485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:35.942001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:36.078261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:36.086384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-892089cd-35f7-4f6e-91e3-31375906d875 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.160381 May 16 16:58:36.086906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 102/210] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:35 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:36.832444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:36.832961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:36.839821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:36.840468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:36.841414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:36.842042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:36.843738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:36.844348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:36.850883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:36.851329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:36.852300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:36.852900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:36.865562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-efa99b51-fa6d-4653-a2d2-eaf95cbfc567 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/ips" status: 200 len: 147 microversion: 2.1 time: 0.037337 May 16 16:58:36.866392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 109/211] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 16:58:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:36.986151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:36.995337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1bdf9f9e-7851-499e-9e41-7ee87e0f1275 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.155073 May 16 16:58:37.005935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 103/212] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:36 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:37.104476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:37.105131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:37.111256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:37.111710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:37.112483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:37.112927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:37.241792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:37.248900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8e36eb22-d28d-45a9-b0fa-558df51273ff tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.148471 May 16 16:58:37.249479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 110/213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:37 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:37.933235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-0da5d95d-f876-46c4-a6d7-de75bf87f906 req-05c75d15-b6ac-4bc6-8711-711f6b65864a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c9ac7f-ecb0-453c-91c2-191f32b2958d", "name": "network-vif-plugged", "status": "completed", "tag": "d27e0ff3-d6c6-4dd0-9992-12170feea445"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:37.941749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0da5d95d-f876-46c4-a6d7-de75bf87f906 req-05c75d15-b6ac-4bc6-8711-711f6b65864a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:37.942213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0da5d95d-f876-46c4-a6d7-de75bf87f906 req-05c75d15-b6ac-4bc6-8711-711f6b65864a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:37.953428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-0da5d95d-f876-46c4-a6d7-de75bf87f906 req-05c75d15-b6ac-4bc6-8711-711f6b65864a service nova] Creating event network-vif-plugged:d27e0ff3-d6c6-4dd0-9992-12170feea445 for instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d on hv-cinder-83998 May 16 16:58:37.959360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-0da5d95d-f876-46c4-a6d7-de75bf87f906 req-05c75d15-b6ac-4bc6-8711-711f6b65864a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029088 May 16 16:58:37.959949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 104/214] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:38.012251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:38.012861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:38.019291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:38.019737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:38.020493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:38.021431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:38.169260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:38.177438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aa1e1cde-9f3b-4c63-b884-52432e1357fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.168853 May 16 16:58:38.178173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 111/215] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:38 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:38.266135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:38.266840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:38.272937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:38.273383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:38.274182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:38.274626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:38.407423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:38.415330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bdaedb16-34cb-471a-b652-0c39bdb84135 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.153348 May 16 16:58:38.415904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 105/216] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:38 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:39.194896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:39.195508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:39.201823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:39.202273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:39.203037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:39.203469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:39.330861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:39.338811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f7399965-4ee8-498c-86ee-92af3f96aa7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.148183 May 16 16:58:39.339379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 112/217] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:39 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:39.432497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:39.433105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:39.439489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:39.439926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:39.440772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:39.441199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:39.566524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:39.574283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f311a56a-f985-4fc4-9e94-378827cf5867 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1365 microversion: 2.1 time: 0.145694 May 16 16:58:39.574844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 106/218] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:39 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:40.355771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:40.356389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:40.362773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:40.363317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:40.364011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:40.364455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:40.518006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:40.527361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-07095fd2-8184-4f85-ba85-e53284d25cac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.175341 May 16 16:58:40.528560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 113/219] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:40 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:40.590964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:40.591579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:40.599176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:40.600974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:40.601973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:40.602470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:40.775768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:40.783849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f2899eee-dadd-44ed-b5bd-adb0ad1a9397 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1555 microversion: 2.1 time: 0.196751 May 16 16:58:40.784768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 107/220] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:40 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:40.801761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:40.803077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:40.809598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:40.810081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:40.810862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:40.811295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:41.143464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-60276a4a-cb3b-4033-a27b-c8dcc5ed1d7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.346173 May 16 16:58:41.144077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 114/221] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 16:58:40 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/os-interface => generated 284 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:41.254336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-73358755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-327983792", "security_groups": [{"name": "tempest-secgroup-smoke-584413273"}], "networks": [{"uuid": "c4db2ae7-746a-432c-a3ed-bfb287e1417e"}], "block_device_mapping_v2": [{"uuid": "5cb93147-ce5f-406b-87fe-c1ac3a463b63", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:41.438049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] validate_networks() for [('c4db2ae7-746a-432c-a3ed-bfb287e1417e', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:58:41.544729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:41.545477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:41.563680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:41.563801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:41.564568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:41.565010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:41.743588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:41.754202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d176d415-fb8a-4523-9fc0-5f8bfbdccb12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.213490 May 16 16:58:41.755449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 115/222] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:41 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:42.074087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a63f98b8-4131-478e-a8be-d2882b59bc67"}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:42.075452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:42.084430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.085183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.086210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.086718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.428584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:58:42.429335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:58:42.429855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:58:42.430380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:58:42.431146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:58:42.437945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5196719d-2479-4cc9-956b-df9c7c9a7689 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369359 May 16 16:58:42.439350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 116/223] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 16:58:42 2022] POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:42.450187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.468943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.473964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.476132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.501225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Getting quotas for project 55fbe5576de844559b26175408f40f3f. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:58:42.507629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Getting quotas for user e0f8b3570fb544c7be48b4bc3401e780 and project 55fbe5576de844559b26175408f40f3f. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:58:42.626429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:58:42.629160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cb93147-ce5f-406b-87fe-c1ac3a463b63',volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:58:42.774361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:42.775506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:42.790177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.790630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.791423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.791858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.843059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7e6cfe48-7287-4a18-b7be-578752019a5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.593053 May 16 16:58:42.844912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 108/224] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:58:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:58:42.854657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-87b82a22-cf02-4c2b-89b1-67db7658b18a req-b21fb015-c93c-4c1b-80d5-eaecc4f92797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33c9ac7f-ecb0-453c-91c2-191f32b2958d", "tag": "d27e0ff3-d6c6-4dd0-9992-12170feea445"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:42.872493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-87b82a22-cf02-4c2b-89b1-67db7658b18a req-b21fb015-c93c-4c1b-80d5-eaecc4f92797 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:42.873183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-87b82a22-cf02-4c2b-89b1-67db7658b18a req-b21fb015-c93c-4c1b-80d5-eaecc4f92797 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:42.889200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-87b82a22-cf02-4c2b-89b1-67db7658b18a req-b21fb015-c93c-4c1b-80d5-eaecc4f92797 service nova] Creating event network-changed:d27e0ff3-d6c6-4dd0-9992-12170feea445 for instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d on hv-cinder-83998 May 16 16:58:42.895980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-87b82a22-cf02-4c2b-89b1-67db7658b18a req-b21fb015-c93c-4c1b-80d5-eaecc4f92797 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049620 May 16 16:58:42.896972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 109/225] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:42.905142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ca2cca67-14e3-4ad0-a6e6-ce7587bfd608 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:42.906121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ca2cca67-14e3-4ad0-a6e6-ce7587bfd608 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:43.080158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:43.088143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b329e609-bdc0-4b37-8595-ab31aa9257d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.320209 May 16 16:58:43.090406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 117/226] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:42 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:43.096273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ca2cca67-14e3-4ad0-a6e6-ce7587bfd608 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:43.104241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ca2cca67-14e3-4ad0-a6e6-ce7587bfd608 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1086 microversion: 2.1 time: 0.205628 May 16 16:58:43.113691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 110/227] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1086 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:44.108193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:44.109441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:44.124574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:44.125430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:44.125848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:44.126651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:44.127042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:44.127810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:44.154108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:44.158177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:44.167071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:44.167736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:44.291938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:44.304754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b1888442-9af1-49d6-9259-92042cffcb38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1184 microversion: 2.1 time: 0.187535 May 16 16:58:44.305988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 111/228] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:44.335377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:44.342941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d4a6754-840e-45fb-8a24-a952ebbb3712 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.240178 May 16 16:58:44.350288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 118/229] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:44 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:45.215994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1669988187", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "networks": [{"uuid": "979f376f-bcac-41e9-ab9d-79ea36489955"}]}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:45.274399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] validate_networks() for [('979f376f-bcac-41e9-ab9d-79ea36489955', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:58:45.329821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:45.330433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:45.342400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:45.343033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:45.343989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:45.344595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:45.563309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:45.574369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c83387b9-ded9-4719-9c6a-b4fe8730d17f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1269 microversion: 2.1 time: 0.253805 May 16 16:58:45.575338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 119/230] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1269 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:45.580732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:45.581829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:45.588665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:45.589448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:45.590603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:45.591391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:45.685688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:58:45.686325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:58:45.686829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:58:45.687237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:58:45.687665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:58:45.696667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:45.697405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:45.698302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:45.698927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:45.719397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Getting quotas for project 860206f7b662414ca56ef58314ad4a5a. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:58:45.723756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Getting quotas for user 6866ee078cd54f469aa188209fac9b95 and project 860206f7b662414ca56ef58314ad4a5a. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:58:45.740921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:58:45.743519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:58:45.799479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-128c327c-8164-41b6-86d9-a30d7b499f85 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587655 May 16 16:58:45.800496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 112/231] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:58:45.811537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-033012b6-8625-4ee9-bb4e-f4fd0e6d95b2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:45.813408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-033012b6-8625-4ee9-bb4e-f4fd0e6d95b2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:45.821204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:45.836997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3926bac6-82b3-4d7e-99ab-e5b83a6ba20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.260408 May 16 16:58:45.846679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 120/232] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:45 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:45.904590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-033012b6-8625-4ee9-bb4e-f4fd0e6d95b2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:45.912254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-033012b6-8625-4ee9-bb4e-f4fd0e6d95b2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1214 microversion: 2.1 time: 0.104134 May 16 16:58:45.913858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 113/233] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:45 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:46.191196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-f4013f09-10e8-46dd-95c4-f42c7252c358 req-231186dc-f56f-4ea0-a066-ea85be263099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c2033c-4fee-4884-a6f7-de043836ebad", "tag": "fd7ba01c-f563-4085-b558-b1c5bd0db5a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:46.202649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-f4013f09-10e8-46dd-95c4-f42c7252c358 req-231186dc-f56f-4ea0-a066-ea85be263099 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.203442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-f4013f09-10e8-46dd-95c4-f42c7252c358 req-231186dc-f56f-4ea0-a066-ea85be263099 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.235414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-f4013f09-10e8-46dd-95c4-f42c7252c358 req-231186dc-f56f-4ea0-a066-ea85be263099 service nova] Creating event network-changed:fd7ba01c-f563-4085-b558-b1c5bd0db5a6 for instance d5c2033c-4fee-4884-a6f7-de043836ebad on hv-cinder-83998 May 16 16:58:46.240855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-f4013f09-10e8-46dd-95c4-f42c7252c358 req-231186dc-f56f-4ea0-a066-ea85be263099 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053242 May 16 16:58:46.242241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 121/234] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:46.316610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-286529405", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "networks": [{"uuid": "dfa64bed-e486-4f5e-8309-9f21280f6cd5"}]}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:46.419165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] validate_networks() for [('dfa64bed-e486-4f5e-8309-9f21280f6cd5', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:58:46.593843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:46.594490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:46.601130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.601591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.602390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.602825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.847725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:46.856132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea32e78e-1b7a-4f40-85a9-42a9c4008920 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1269 microversion: 2.1 time: 0.268157 May 16 16:58:46.856730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 122/235] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1269 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:46.862509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:46.863116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:46.869508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.870001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.870775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.871216 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.894258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:58:46.894681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:58:46.895159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:58:46.895570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:58:46.895987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:58:46.904931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.905416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.906281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:46.906711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:46.923007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Getting quotas for project e07bcaeeb617491689c13594914b370e. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:58:46.927042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Getting quotas for user 3ab541e9017c4ece9432f1fedde0f64e and project e07bcaeeb617491689c13594914b370e. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:58:46.938504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:58:46.940637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:58:46.985694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1522c341-1e2e-40b4-abf0-1f8ff54017da tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673121 May 16 16:58:46.988005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 114/236] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 16:58:46.992635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:46.993401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:46.998655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:47.003497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:47.003778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:47.004702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:47.006070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:47.020239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6249c9ca-7ee6-40e5-9a73-d78841814b94 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.160512 May 16 16:58:47.031420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 123/237] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:46 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:47.038448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e5c819b2-3cae-4ff8-ad2c-c173ce208cfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:47.039062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e5c819b2-3cae-4ff8-ad2c-c173ce208cfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:47.082505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:47.092455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-25f2e97c-61a7-48de-9b2d-d0ba33dd1e06 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1266 microversion: 2.1 time: 0.104669 May 16 16:58:47.094907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 115/238] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:46 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:47.095749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e5c819b2-3cae-4ff8-ad2c-c173ce208cfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:47.108622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e5c819b2-3cae-4ff8-ad2c-c173ce208cfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1218 microversion: 2.1 time: 0.076054 May 16 16:58:47.109211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 124/239] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:47 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:47.874011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:47.874690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:47.881451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:47.881932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:47.882705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:47.883142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.010084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:48.023856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0f2dcb2-79c4-42fe-85d1-1ad7a300d0be tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1269 microversion: 2.1 time: 0.153517 May 16 16:58:48.024724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 116/240] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:48.044118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:48.045574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:48.052814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:48.053353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.054256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:48.054782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.111046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:48.111925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:48.118141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:48.118680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.119759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:48.119894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.199843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:48.208032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d102e893-9171-4805-8a83-ec468c690852 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.167963 May 16 16:58:48.208647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 125/241] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:48 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:48.213817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:48.215420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:48.222648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:48.223102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.223896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:48.224785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:48.292505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:48.300609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-11cbdb0b-2a34-4622-a87a-338204c1d101 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1214 microversion: 2.1 time: 0.090641 May 16 16:58:48.301213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 126/242] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:48 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:48.398361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:48.406316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4d7f3060-b37d-4432-8423-a40f8894a794 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1272 microversion: 2.1 time: 0.298978 May 16 16:58:48.406901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 117/243] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:48 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:49.002879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:49.003364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:49.009198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.009642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.010429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.010885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.033899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f25d1a54-2f8e-482d-b388-dfd1e31090c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/ips" status: 200 len: 152 microversion: 2.20 time: 0.034802 May 16 16:58:49.034856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 127/244] 10.222.0.70 () {60 vars in 1288 bytes} [Mon May 16 16:58:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:58:49.040956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:49.041584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:49.047988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.048439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.049250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.049691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.182694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:49.190783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-279c2706-15b3-4e46-995f-2366383d4463 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1269 microversion: 2.1 time: 0.154305 May 16 16:58:49.191354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 118/245] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:49.225728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:49.226911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:49.242305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.243018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.243810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.244215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.322439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:49.323068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:49.335044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.335690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.339813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.340541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.433648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:49.439613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:49.450966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-730d604f-6749-4df1-997b-3787e5d9c66f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1270 microversion: 2.1 time: 0.137187 May 16 16:58:49.451554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 119/246] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:49 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:49.453605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a0600bf0-0e87-492a-a03d-ac3f42ac72d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.232863 May 16 16:58:49.454660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 128/247] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:49 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:49.459343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:49.460138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:49.466364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.466800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.467709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.468143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:49.676173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:49.684548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2fdc2cef-0a0c-470e-9492-be2a7e2d47cb tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.231898 May 16 16:58:49.685123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 120/248] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:49 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:49.983570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-d8306012-379e-44b0-9b05-8e89a532f7e3 req-906ecdc4-cd49-422a-a559-9749e7df5eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef025449-6f1e-4050-b5fc-2500cbbc0fd8", "tag": "eb7b42a5-14e3-480b-9aeb-22ceda9c7644"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:49.992384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-d8306012-379e-44b0-9b05-8e89a532f7e3 req-906ecdc4-cd49-422a-a559-9749e7df5eb1 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:49.992826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-d8306012-379e-44b0-9b05-8e89a532f7e3 req-906ecdc4-cd49-422a-a559-9749e7df5eb1 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.004839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-d8306012-379e-44b0-9b05-8e89a532f7e3 req-906ecdc4-cd49-422a-a559-9749e7df5eb1 service nova] Creating event network-changed:eb7b42a5-14e3-480b-9aeb-22ceda9c7644 for instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 on hv-cinder-83998 May 16 16:58:50.011351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-d8306012-379e-44b0-9b05-8e89a532f7e3 req-906ecdc4-cd49-422a-a559-9749e7df5eb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031120 May 16 16:58:50.012316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 129/249] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:50.207884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:50.208499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:50.219814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.220266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.221219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.222997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.474963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:50.475629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:50.483094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.483578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.484565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.485006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.505047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:50.513456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c0f6f793-a867-4721-a1f9-db9e883cc0e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1269 microversion: 2.1 time: 0.309151 May 16 16:58:50.514378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 121/250] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1269 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:50.519935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:50.520803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:50.528050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.528500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.529950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.530386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.624666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:50.633044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b82f8934-d40b-488a-935d-df064c7d019f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1276 microversion: 2.1 time: 0.117326 May 16 16:58:50.633769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 122/251] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:50 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:50.694539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:50.706935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-422d8c92-b3e3-4ef8-bfb1-612b337a7525 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.237839 May 16 16:58:50.708320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 130/252] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:50 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:50.711796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:50.712652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:50.719307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.720087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.721147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:50.721815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:50.892250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:50.900554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5813d803-993b-4278-89a6-1fab7a812997 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.198978 May 16 16:58:50.901142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 123/253] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:50 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:51.142027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a0c912e6-289b-452c-bc3b-b022da1ebf78 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:51.148335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0c912e6-289b-452c-bc3b-b022da1ebf78 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.149009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0c912e6-289b-452c-bc3b-b022da1ebf78 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.217718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a0c912e6-289b-452c-bc3b-b022da1ebf78 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Going to try to stop instance {{(pid=117184) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 16:58:51.279324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a0c912e6-289b-452c-bc3b-b022da1ebf78 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/action" status: 202 len: 0 microversion: 2.1 time: 0.140908 May 16 16:58:51.280521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 131/254] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 16:58:51 2022] POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 16:58:51.289851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:51.291078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.297683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.298172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.298953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.299393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.331644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:51.332257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.339212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.339947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.340726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.341224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.365287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lazy-loading 'flavor' on Instance uuid 066f9c81-9fa1-430d-9691-d04ea3c538de {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:58:51.438796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:51.447119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e9f3352-db3a-4085-924f-f23574aadd1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.161796 May 16 16:58:51.447775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 124/255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:51.532126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:51.532944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.540666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.541118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.542129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.542564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.675483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-88696257-1fca-4722-8dd5-a78564ef86f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/action" status: 202 len: 0 microversion: 2.20 time: 0.347862 May 16 16:58:51.676665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 132/256] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 16 16:58:51 2022] POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 16:58:51.682795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:51.683488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.690457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.690907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.691682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.692111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.695093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:51.702669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e745d57e-cd6c-449f-99dc-f9f3dcb31766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.174414 May 16 16:58:51.703669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 125/257] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:51 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:51.708290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:51.710143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.717544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.718218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.719205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.719734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.828459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:51.836546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0a775db8-acaf-4166-9740-990ef3b305c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.158583 May 16 16:58:51.837121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 133/258] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:51 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:51.841409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-c31523b2-f2ac-4004-b2b0-6aa6539edeff req-b4c94949-537d-4b87-bb99-257ab98c90b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d63564-f586-464a-9794-cd3ab451b3aa", "tag": "aefc72a5-6bd1-4050-bc04-d86487257c17"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:51.848943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-c31523b2-f2ac-4004-b2b0-6aa6539edeff req-b4c94949-537d-4b87-bb99-257ab98c90b9 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.849671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-c31523b2-f2ac-4004-b2b0-6aa6539edeff req-b4c94949-537d-4b87-bb99-257ab98c90b9 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.857020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:51.860293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-c31523b2-f2ac-4004-b2b0-6aa6539edeff req-b4c94949-537d-4b87-bb99-257ab98c90b9 service nova] Creating event network-changed:aefc72a5-6bd1-4050-bc04-d86487257c17 for instance 81d63564-f586-464a-9794-cd3ab451b3aa on hv-cinder-83998 May 16 16:58:51.865275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-c31523b2-f2ac-4004-b2b0-6aa6539edeff req-b4c94949-537d-4b87-bb99-257ab98c90b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027080 May 16 16:58:51.865417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:51.865888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 134/259] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:51.866998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:51.881075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e23e71e7-54e4-423b-98c2-ea0cd3fadd4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.164397 May 16 16:58:51.881075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 126/260] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:58:51.881288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:51.881288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.882536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.883060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.883903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.884390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.916464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:51.917104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:51.923141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.923601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:51.924372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:51.924805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.010843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:52.018288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-80ca8144-1f70-45d5-ac75-368c4979acf9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.151283 May 16 16:58:52.018874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 135/261] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:51 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:52.050319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:52.058001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-69c9bb70-f784-4f3e-a5f3-77c224512d0e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.145478 May 16 16:58:52.058575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 127/262] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:51 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:52.465517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:52.466153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:52.472068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.472514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.473277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.473711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.597075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:52.605315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33e6ef97-6512-4d05-8979-f44a4dcfe094 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.143672 May 16 16:58:52.605927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 136/263] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:52.720293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:52.720837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:52.727962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.728411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.729175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.729638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.854326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:52.855659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:52.862193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.862864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.863820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.864524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.871675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:52.879105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55bf0cc9-f542-420a-ab2a-8718c941a06d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.162708 May 16 16:58:52.879675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 128/264] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:52.892597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:52.893208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:52.899780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.900229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:52.900996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:52.901434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.001802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.009163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4f4554e2-8db7-4083-9be2-2123e620c233 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.159843 May 16 16:58:53.009759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 137/265] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:52 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:53.033563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.035319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:53.035927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:53.042316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.042884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.043331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.044066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.044175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.044499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.045382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e2d58b1b-780f-4308-aa62-969c7cf2d0f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.156571 May 16 16:58:53.045978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 129/266] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:58:53.075114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:53.075842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:53.082353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.082808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.084195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.084633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.171107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.179465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d67818c4-85e7-47ae-953e-ffcc1e68b8f9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.147890 May 16 16:58:53.180349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 138/267] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:53 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:53.224723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.231895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1d9ba4ab-7cc4-4c87-85b9-333811e579ba tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.160640 May 16 16:58:53.232398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 130/268] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:53 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:53.623155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:53.623777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:53.631101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.631710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.632623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.633165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.896422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:53.897892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:53.898027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:53.905291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.906006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.906933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:53.907255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f1a35c6c-d010-473d-9414-1574ceacd9c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.287925 May 16 16:58:53.907954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:53.917994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 139/269] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:54.027310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:54.027955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:54.034663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.035352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.036131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.037166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.051668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.060309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b7cb4fae-34d8-4da1-bafc-1a2a11a42311 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.167928 May 16 16:58:54.060819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 131/270] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:54.065789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:54.066622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:54.072816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.073543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.074772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.075408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.211959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.219985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.221499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.222711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2b857c76-4bd9-43c0-84ad-a92a970c233c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.160810 May 16 16:58:54.233921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 132/271] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:58:54.233921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:54.233921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:54.234500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.234955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.235748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.236189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.304108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.311550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9b1195b3-1a23-4464-851a-efe7d3c0ef9f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.289406 May 16 16:58:54.312126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 140/272] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:54 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:54.317225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:54.318041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:54.324230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.324672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.325492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.325947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.367633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.375804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3e0514f3-71aa-4f6e-8e52-3e35279d6283 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.151499 May 16 16:58:54.376383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 133/273] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:54 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:54.527644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:54.534771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d16c98bd-c5e8-4825-82fb-0045857bd55d tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.221552 May 16 16:58:54.535645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 141/274] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:54 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:54.924387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:54.924988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:54.931977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.932429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:54.933197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:54.933640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.055588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.063360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c79e1302-4d4d-4b01-9e4c-40ffdca16f50 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.142911 May 16 16:58:55.063933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 134/275] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:55.076279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:55.076906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:55.083304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.083753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.085354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.085900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.210450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.217589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4e2fa610-570a-4447-9baf-546734d966b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.145075 May 16 16:58:55.218206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 142/276] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:55.240145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:55.240758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:55.246522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.246970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.247732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.248170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.328278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:55.328896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:55.335610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.336065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.336836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.337273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.374185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.382524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.384041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.385209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f09570fd-6421-4bc8-83b4-21d1486a4010 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.148877 May 16 16:58:55.387326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 135/277] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:58:55.392052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:55.392663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:55.400162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.400617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.401394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.401861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.469871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.479509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f9f189ea-e5f8-4521-8db5-536ffe60faa9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.154974 May 16 16:58:55.480092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 143/278] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:55 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:55.530158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.537439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-102ccaa0-5731-4f71-b1da-49a8b270b436 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.148939 May 16 16:58:55.538048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 136/279] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:55 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:55.551818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:55.552435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:55.558290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.558738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.559503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:55.559941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:55.685019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:55.692153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a7ac5b19-dc03-41e9-9dcf-0a56fe7d6aa6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.144067 May 16 16:58:55.692724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 144/280] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:55 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:56.059468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-9c9d9a10-9216-40d7-bd4c-13eca3ad4b2d req-a9dc9279-528b-45d2-997d-8034e96ee96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef025449-6f1e-4050-b5fc-2500cbbc0fd8", "name": "network-vif-plugged", "status": "completed", "tag": "eb7b42a5-14e3-480b-9aeb-22ceda9c7644"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:58:56.068026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-9c9d9a10-9216-40d7-bd4c-13eca3ad4b2d req-a9dc9279-528b-45d2-997d-8034e96ee96b service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.069081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-9c9d9a10-9216-40d7-bd4c-13eca3ad4b2d req-a9dc9279-528b-45d2-997d-8034e96ee96b service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.080934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:56.081504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-9c9d9a10-9216-40d7-bd4c-13eca3ad4b2d req-a9dc9279-528b-45d2-997d-8034e96ee96b service nova] Creating event network-vif-plugged:eb7b42a5-14e3-480b-9aeb-22ceda9c7644 for instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 on hv-cinder-83998 May 16 16:58:56.081596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:56.086755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-9c9d9a10-9216-40d7-bd4c-13eca3ad4b2d req-a9dc9279-528b-45d2-997d-8034e96ee96b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 May 16 16:58:56.087547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 137/281] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:58:56.090028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.090474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.091315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.091652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.222772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.230860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6cce02bb-1408-46b2-a80b-b518d8c84e43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.154057 May 16 16:58:56.240510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 145/282] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:56.245067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:56.245877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:56.252043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.252574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.253338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.253805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.384466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.391805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-11330ca1-e6c3-4ba2-b222-0ffc77975f19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.160313 May 16 16:58:56.392372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 138/283] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:56.403626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:56.404227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:56.410180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.410627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.411393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.411869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.496635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:56.497284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:56.503094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.503543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.504307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.504738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.538712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.546544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.548087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.549363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-96077208-4afe-48f8-b6b7-2ae5165e3547 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.149715 May 16 16:58:56.549976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 146/284] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:58:56.554996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:56.555602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:56.561504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.561990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.562758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.563193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.632339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.639509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2f4710b4-586e-4622-8b81-54175863b9db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.146700 May 16 16:58:56.640294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 139/285] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:56 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:56.692824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.700857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cbf7a4e1-c177-47b1-9ea7-ed76d8d047a3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.149927 May 16 16:58:56.701436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 147/286] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:56 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:56.708792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:56.709518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:56.715602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.716049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.716813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:56.717247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:56.847165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:56.855177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-65ea3bc7-ace1-4554-8847-eda3c34617d2 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.150740 May 16 16:58:56.855746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 140/287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:56 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:57.248396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:57.249002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:57.255222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.255669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.256432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.256858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.379110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.386845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2479027b-b0ab-4e4b-80dc-43c6e9b5d8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.142338 May 16 16:58:57.387407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 148/288] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:57.410346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:57.411576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:57.418592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.419043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.419814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.420250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.547245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.554614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-87b00f56-78c8-4b59-bcb2-fb91726165c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.148152 May 16 16:58:57.555184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 141/289] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:57.567909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:57.569017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:57.574811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.575641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.576408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.576843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.656491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:57.657242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:57.663231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.663682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.664457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.664894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.705341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.714130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.715637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.716831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fbe6306e-97fc-4229-92dc-d2b3b2908000 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.152728 May 16 16:58:57.717392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 149/290] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:58:57.721666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:57.722416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:57.729414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.729894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.730657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.731088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.791768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.798974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4c4f7183-56cd-4f4f-9853-9cecd6f14c1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.146477 May 16 16:58:57.799540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 142/291] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:57 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:57.858815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:57.866025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6557a2fc-b3fd-4bf7-a384-7e78a33d8a44 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.147653 May 16 16:58:57.866604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 150/292] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:57 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:57.871815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:57.872436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:57.878609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.879063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:57.879837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:57.880320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.008094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.015271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ecf49b71-c35a-48aa-87f0-da36f9a2028a tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1314 microversion: 2.1 time: 0.147294 May 16 16:58:58.015842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 143/293] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:57 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:58.403951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:58.404565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:58.410987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.411434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.412707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.413129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.548302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.556697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fded552d-8900-4dae-b825-4213685c28c9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.156671 May 16 16:58:58.557262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 151/294] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:58.571021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:58.571631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:58.578106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.578591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.579352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.579784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.710048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.717520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-adb5685d-140b-41d7-8533-e4c9c4b0d10e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.150227 May 16 16:58:58.718134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 144/295] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:58.735385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:58.736285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:58.742322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.742797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.743569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.744009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.815970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:58.816622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:58.822822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.823325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.824064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.824498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.879497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.887208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.888702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.889894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-745018e8-2bd3-485d-af05-d37ca18c0d96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.158450 May 16 16:58:58.890464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 152/296] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:58:58.894802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:58.895404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:58.903195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.903653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.904471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:58.904908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:58.961165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:58.968478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-18e2d132-ae84-454b-bb4d-53a9ab13c82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.156487 May 16 16:58:58.969059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 145/297] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:58 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:59.030408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:59.031182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:59.031889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:59.038583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.039033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.039805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.039951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f61147a-755f-49cd-858b-439b32df4623 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.148485 May 16 16:58:59.040237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.040717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 153/298] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:58 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:59.166781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:59.174994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-857047d6-d1fd-4999-b4b3-bb299f502821 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1498 microversion: 2.1 time: 0.147758 May 16 16:58:59.175888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 146/299] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:59 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:59.574177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:59.574786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:59.581128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.581574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.582370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.582802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.709374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:59.721909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f8b7c56-2154-45bd-a12e-63029e2817d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.151560 May 16 16:58:59.722495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 154/300] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:58:59.735247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:59.736041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:59.743192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.743641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.744405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.744840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.840131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:59.840623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:59.846373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.846821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.847582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.848015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.873763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 16:58:59.874114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:58:59.881465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-78ae9bf0-b313-4764-8b83-e4bbac9883a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.150381 May 16 16:58:59.882059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 147/301] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:58:59.908459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:59.909113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:59.915732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.916172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.916927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.917378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.949137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3bb7ab57-3d29-4c56-bad5-74e097a60215 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 204 len: 0 microversion: 2.1 time: 0.112575 May 16 16:58:59.949726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 155/302] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 16:58:59 2022] DELETE /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 16:58:59.957921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:58:59.958579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:58:59.964217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.964659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:58:59.965413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:58:59.965872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.063551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.072789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.074352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.075532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-779d4045-c704-45ad-94fe-055c0cc5f294 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.170875 May 16 16:59:00.076339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 148/303] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:58:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:00.081369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:00.081596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:00.087887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.088353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.089132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.089570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.125239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.133381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fa80a761-3090-49de-b636-e60e360103a6 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1504 microversion: 2.1 time: 0.179350 May 16 16:59:00.133934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 156/304] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:58:59 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:00.138614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:00.139469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:00.145642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.146127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.147438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.147879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.238405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.247233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-306b0ae6-6e15-4541-9148-54cdd54072e8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.170038 May 16 16:59:00.255186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 149/305] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:00 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:00.255186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-26df00c6-cf5f-495f-932d-0098f198aafe req-c7b4e1f6-cc98-4596-8adc-4da362a7e98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d63564-f586-464a-9794-cd3ab451b3aa", "name": "network-vif-plugged", "status": "completed", "tag": "aefc72a5-6bd1-4050-bc04-d86487257c17"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:00.268186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-26df00c6-cf5f-495f-932d-0098f198aafe req-c7b4e1f6-cc98-4596-8adc-4da362a7e98d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.268629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-26df00c6-cf5f-495f-932d-0098f198aafe req-c7b4e1f6-cc98-4596-8adc-4da362a7e98d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.279827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-26df00c6-cf5f-495f-932d-0098f198aafe req-c7b4e1f6-cc98-4596-8adc-4da362a7e98d service nova] Creating event network-vif-plugged:aefc72a5-6bd1-4050-bc04-d86487257c17 for instance 81d63564-f586-464a-9794-cd3ab451b3aa on hv-cinder-83998 May 16 16:59:00.284929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-26df00c6-cf5f-495f-932d-0098f198aafe req-c7b4e1f6-cc98-4596-8adc-4da362a7e98d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035258 May 16 16:59:00.285515 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 150/306] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:00.296498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.303856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a58cb485-fd7f-4384-9ec6-16f948c023c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.168888 May 16 16:59:00.304424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 157/307] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:00 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:00.740243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:00.740934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:00.747392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.747838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.748596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.749024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.878579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:00.886900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d2bb49aa-784d-465f-884d-089ce3f467c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.150876 May 16 16:59:00.887472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 151/308] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:00.898984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:00.899599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:00.905728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.906196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:00.906962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:00.907395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.032574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.039930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b0f67859-573a-4a0c-b9a3-557dbfc17ca0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.145478 May 16 16:59:01.040503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 158/309] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:01.093533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:01.094169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:01.100446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.100889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.101649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.102108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.150368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:01.151011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:01.156900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.157438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.158311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.158853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.225768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.233449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.234996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.236165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b6f52696-0036-4a94-a963-f6cb4f73792c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.146622 May 16 16:59:01.236730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 152/310] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:01.264453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:01.265060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:01.270889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.271331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.272089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.272514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.296112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.303977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-058e9d75-7bbd-4b65-8f4c-45e0511458e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1504 microversion: 2.1 time: 0.157542 May 16 16:59:01.304546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 159/311] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:01 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:01.320001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:01.320610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:01.326380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.326829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.327590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.328024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.397526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.404964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a7a2287e-4ab5-4dc6-b749-b91757b4d313 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.144388 May 16 16:59:01.405607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 153/312] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:01 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:01.453460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:01.460781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-77e2741f-1d0d-4b54-8031-a2c607188c49 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.144482 May 16 16:59:01.461349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 160/313] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:01 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:01.903904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:01.904515 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:01.910820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.911272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:01.912037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:01.913112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.058861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:02.059737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:02.064243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.070074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.074939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.075771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.076208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.094253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3d3fd21b-3034-48a6-a659-4e3387202137 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.194066 May 16 16:59:02.095187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 154/314] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:02.262428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:02.263174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:02.269312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.269937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.270744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.271181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.295750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.303412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2ee3bce0-bcec-43cf-8eaa-c9e7298f43f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.249674 May 16 16:59:02.306128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 161/315] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:02.320897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:02.321512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:02.327691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.328146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.328919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.329355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.413849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.422170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.423715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.424890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-58c53018-5ea0-4c74-b3c7-a921fd5064c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.173311 May 16 16:59:02.425461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 155/316] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:02.431019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:02.431634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:02.438065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.438428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.439327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.439764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.547294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.555303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-05cc2a5f-fcaa-41ab-9f1e-516932075414 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1504 microversion: 2.1 time: 0.238722 May 16 16:59:02.556184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 162/317] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:02 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:02.570520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:02.571159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:02.571913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.577083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.577541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.578593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.579699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.579816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5139be78-b48c-49cb-90b2-c099910927df tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.152794 May 16 16:59:02.580697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 156/318] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:02 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:02.763324 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-a453bc30-df4d-48a5-a74f-6972d8fdff0c req-bd4dd6a8-e58a-4f52-9ce6-a573846fe6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef025449-6f1e-4050-b5fc-2500cbbc0fd8", "name": "network-vif-deleted", "tag": "eb7b42a5-14e3-480b-9aeb-22ceda9c7644"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:02.771309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-a453bc30-df4d-48a5-a74f-6972d8fdff0c req-bd4dd6a8-e58a-4f52-9ce6-a573846fe6fa service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:02.771760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-a453bc30-df4d-48a5-a74f-6972d8fdff0c req-bd4dd6a8-e58a-4f52-9ce6-a573846fe6fa service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:02.783345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-a453bc30-df4d-48a5-a74f-6972d8fdff0c req-bd4dd6a8-e58a-4f52-9ce6-a573846fe6fa service nova] Creating event network-vif-deleted:eb7b42a5-14e3-480b-9aeb-22ceda9c7644 for instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 on hv-cinder-83998 May 16 16:59:02.789062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-a453bc30-df4d-48a5-a74f-6972d8fdff0c req-bd4dd6a8-e58a-4f52-9ce6-a573846fe6fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029342 May 16 16:59:02.790045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 157/319] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:02.792677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:02.800199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-63a671c3-c473-4269-9cfa-aef31969a62b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.234028 May 16 16:59:02.800767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 163/320] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:02 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:03.112665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:03.113381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:03.120101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.120555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.121320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.121774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.245978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.253649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-09b40e71-9bc0-41bf-8bef-994f84220f93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.145681 May 16 16:59:03.254248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 158/321] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:03.320831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:03.321457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:03.327818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.328278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.329171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.329504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.444109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:03.444811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:03.453037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.453482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.454278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.454707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.459365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.467539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6a01ceee-a3a4-4634-9216-3e3809231c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.151210 May 16 16:59:03.473844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 164/322] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:03.573261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:03.573909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:03.580349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.580872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.581724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.582245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.592038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.600530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.602073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.603224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9569928b-ede4-44df-93e8-107cd24295c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.163630 May 16 16:59:03.603777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 159/323] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:03.608146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:03.608753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:03.614848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.615888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.616644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.617078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.617339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.617806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.618248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lazy-loading 'fault' on Instance uuid ef025449-6f1e-4050-b5fc-2500cbbc0fd8 {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:59:03.659856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.667712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eb20e983-a3df-4990-9b26-1f771e3b18c5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1304 microversion: 2.1 time: 0.099373 May 16 16:59:03.668279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 165/324] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:03 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:03.742574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.749825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-71d13763-0777-45a3-9d8f-ff9efbdaef51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1506 microversion: 2.1 time: 0.145094 May 16 16:59:03.750391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 160/325] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:03 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:03.817222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:03.817947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:03.824137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.824577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.825388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:03.825834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:03.957662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:03.965399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3bc32e75-6b12-4120-9395-e562ae3f9cb6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.151963 May 16 16:59:03.966007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 166/326] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:03 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:04.270593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:04.272206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:04.283966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-bc981674-a970-401c-bc59-8b97bd9b475a req-a1098cc9-7adb-489d-829e-910c4918e921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c2033c-4fee-4884-a6f7-de043836ebad", "name": "network-vif-plugged", "status": "completed", "tag": "fd7ba01c-f563-4085-b558-b1c5bd0db5a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:04.288460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.288979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.289821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.290304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.293297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-bc981674-a970-401c-bc59-8b97bd9b475a req-a1098cc9-7adb-489d-829e-910c4918e921 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.293937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-bc981674-a970-401c-bc59-8b97bd9b475a req-a1098cc9-7adb-489d-829e-910c4918e921 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.305434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-bc981674-a970-401c-bc59-8b97bd9b475a req-a1098cc9-7adb-489d-829e-910c4918e921 service nova] Creating event network-vif-plugged:fd7ba01c-f563-4085-b558-b1c5bd0db5a6 for instance d5c2033c-4fee-4884-a6f7-de043836ebad on hv-cinder-83998 May 16 16:59:04.310800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-bc981674-a970-401c-bc59-8b97bd9b475a req-a1098cc9-7adb-489d-829e-910c4918e921 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030436 May 16 16:59:04.311482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 167/327] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:04.485574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:04.486414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:04.492896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.493436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.494332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.494779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.662952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:04.664954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:04.671728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2bf014e5-dc54-4c8b-92fd-7fd8aa2a0e1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.190800 May 16 16:59:04.672397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 168/328] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:04.676673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2565d59e-a5fe-491b-8ad4-34d461ffa804 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.409528 May 16 16:59:04.676979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:04.677576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:04.682035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 161/329] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:04.689669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:04.689881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.690313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.690807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:04.691223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.691729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.698283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.698731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.699508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.699935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.737880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.738328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.738781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lazy-loading 'fault' on Instance uuid ef025449-6f1e-4050-b5fc-2500cbbc0fd8 {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:59:04.782015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:04.789889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-35942886-3038-4464-989a-1e94e2cc2497 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 200 len: 1304 microversion: 2.1 time: 0.105514 May 16 16:59:04.790470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 162/330] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:04 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:04.878479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:04.891500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:04.893001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:04.894298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d01d2e48-c62a-4dae-81aa-e566a0e49fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.220742 May 16 16:59:04.894879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 169/331] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:04.982876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:04.983490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:04.989268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.989716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:04.991038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:04.991617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.120914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:05.128271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d2e5eda7-b01c-4001-9a29-680096780e78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.149236 May 16 16:59:05.128772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 163/332] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:04 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:05.690812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:05.691600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:05.698213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.698664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.699076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:05.699669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.699762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:05.699861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.706761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.707560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.708251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.837841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:05.838356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:05.845525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d6b82be2-ed14-4ea5-a1f8-bd9c2fd270f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.158647 May 16 16:59:05.846109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce49c1f5-5344-4361-8566-f62db8260f96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.151593 May 16 16:59:05.846272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 170/333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:05.846670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 164/334] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:05.851098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:05.851930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: ef025449-6f1e-4050-b5fc-2500cbbc0fd8] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:05.857626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.858140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.858901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.859333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.872031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] HTTP exception thrown: Instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 could not be found. May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Request method failure captured: May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 HTTP/1.1 May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoLDMzuf0tjfqSlcW3MBOx1ycnQzt80yCQYm-dti246F4CxJCzcbQOnJAQxbCykXa7h7ZBRsQrd1UJ7efhmhgtfixtsNPjIXx12n7lO8smFNxJQtT2taXoRhUs3EvLdwdZieOI6JwrJTG0kVlr4WUzd63Qd4qz_4WigShWGPhLh5ZB8 May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 860206f7b662414ca56ef58314ad4a5a May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesActionsTest-1611832481 May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:59:05.873626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesActionsTest-1611832481 May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 860206f7b662414ca56ef58314ad4a5a May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesActionsTest-1611832481 May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesActionsTest-1611832481-project May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 6866ee078cd54f469aa188209fac9b95 May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesActionsTest-1611832481-project May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 could not be found. May 16 16:59:05.875210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'ef025449-6f1e-4050-b5fc-2500cbbc0fd8'} May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 could not be found. May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:59:05.876042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 could not be found. May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 could not be found. May 16 16:59:05.877298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:05.878378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Returning 404 to user: Instance ef025449-6f1e-4050-b5fc-2500cbbc0fd8 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:59:05.878378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f5b27025-11f5-486a-9af3-9ea035be3f3f tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8" status: 404 len: 111 microversion: 2.1 time: 0.027992 May 16 16:59:05.878378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 171/335] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:05 2022] GET /compute/v2.1/servers/ef025449-6f1e-4050-b5fc-2500cbbc0fd8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 16:59:05.912119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:05.912729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:05.918659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.919117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.919890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:05.920321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:05.924580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-404520576", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "networks": [{"uuid": "979f376f-bcac-41e9-ab9d-79ea36489955"}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:05.982554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] validate_networks() for [('979f376f-bcac-41e9-ab9d-79ea36489955', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 16:59:06.049009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:06.059078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:06.060825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:06.062085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b37aaa6c-668e-458c-926c-019b752334f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.153731 May 16 16:59:06.073172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 165/336] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:06.144141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:06.144748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:06.151220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.151668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.152433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.152864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.290754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:06.304947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-99d0b161-7cee-4a60-8b3a-b8e9f521f548 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.164448 May 16 16:59:06.305530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 166/337] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:06 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:06.324846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 16:59:06.325268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 16:59:06.325754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 16:59:06.326183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 16:59:06.326624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 16:59:06.335102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.335546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.336341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.336778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.352862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Getting quotas for project 860206f7b662414ca56ef58314ad4a5a. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:59:06.356792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Getting quotas for user 6866ee078cd54f469aa188209fac9b95 and project 860206f7b662414ca56ef58314ad4a5a. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:59:06.367906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 16:59:06.370165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 16:59:06.417431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17dea68f-5f2c-4682-b468-54de0c316a1b tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496584 May 16 16:59:06.418133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 172/338] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 16:59:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 16:59:06.428417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-130a983b-994b-4eef-bb39-ed6c47049a48 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:06.429028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-130a983b-994b-4eef-bb39-ed6c47049a48 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:06.482133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-130a983b-994b-4eef-bb39-ed6c47049a48 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:06.488923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-130a983b-994b-4eef-bb39-ed6c47049a48 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1213 microversion: 2.1 time: 0.064840 May 16 16:59:06.489501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 167/339] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:06 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:06.862935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:06.863551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:06.863739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:06.864419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:06.870544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.870995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.871246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.871693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.871799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.872217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:06.872458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:06.872897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.003586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.010978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.011516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0eb7b06f-91e3-4728-91c8-32ce2395ad86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.151675 May 16 16:59:07.012101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 168/340] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:07.018376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e99d598e-674f-427e-be7c-304002d8283a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1257 microversion: 2.1 time: 0.160116 May 16 16:59:07.018940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 173/341] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:07.080361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:07.081019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:07.088823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:07.089272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.090086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:07.090517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.233349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.241085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.242619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.243806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-69849640-0d79-43af-924d-147c92b334c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.167403 May 16 16:59:07.244629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 169/342] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:07.322029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:07.322640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:07.328467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:07.328927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.329683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:07.330142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.463487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.470736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f66d155-4056-426f-a593-aad0ecbd45cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.153244 May 16 16:59:07.471295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 174/343] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:07 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:07.507241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:07.507885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:07.513946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:07.514408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.515177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:07.515620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:07.577972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:07.585981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-450a9510-3bdf-4531-a90d-10c7d5043893 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1265 microversion: 2.1 time: 0.083136 May 16 16:59:07.586580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 170/344] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:07 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:08.027811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:08.028419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:08.035013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.035438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:08.035873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.036108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:08.036210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.036635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.042930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.043382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.044147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.044583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.172248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.172740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.180536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ee6ff9b1-9bee-4c8b-aed5-dfbcd687f73c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1440 microversion: 2.1 time: 0.148816 May 16 16:59:08.181117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 171/345] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1440 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:08.185334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8173d8b9-3051-4083-b596-c3915578a16a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.161031 May 16 16:59:08.186225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:08.196897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:08.197507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:08.203460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.203909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.204676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.205108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.261940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:08.262551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:08.268389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.268840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.269605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.270080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.341053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.348343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-60010630-31d9-4308-a878-2058e31dfb9b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1440 microversion: 2.1 time: 0.155139 May 16 16:59:08.349291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 172/347] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1440 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:08.410544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.426656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.428825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.429977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c82bd7e8-1480-4ef9-b122-1ae665b069e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.171970 May 16 16:59:08.430825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 176/348] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:08.487774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:08.488407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:08.494902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.495361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.496144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.496748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.603258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:08.604068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:08.610213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.610888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.611894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:08.612336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:08.644179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.651525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c5e4bc15-9061-4e7b-91f9-b1594f99bd6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1522 microversion: 2.1 time: 0.167720 May 16 16:59:08.652165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 173/349] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:08 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:08.680855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:08.688079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a74c3f44-83cc-4834-9c6a-30799a6791c0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1265 microversion: 2.1 time: 0.089057 May 16 16:59:08.688871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 177/350] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:08 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:09.202953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:09.203499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:09.210446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.210901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.211669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.212107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.351766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:09.362164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-36b30ce9-24f5-41ae-bd47-4c0a2da0e909 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.162585 May 16 16:59:09.362893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 174/351] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:09.448203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:09.448956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:09.455380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.455768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.456536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.456977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.659121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:09.668475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:09.669092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:09.675078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.675724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.676065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:09.676503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.676935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.677667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:09.679350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5effc2d2-4108-4678-ae1d-82aabdeb6047 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1724 microversion: 2.20 time: 0.235690 May 16 16:59:09.680211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 178/352] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:09.705352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:09.706253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:09.713097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.713811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.714597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.715137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.799209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:09.806782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b46d9242-a1c5-44b0-ac4a-acd219958b6c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1265 microversion: 2.1 time: 0.105098 May 16 16:59:09.815876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 179/353] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:09 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:09.832186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:09.840568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e2370502-cdbd-4522-aa06-dc7bc37518d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1502 microversion: 2.1 time: 0.175997 May 16 16:59:09.841163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 175/354] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:09 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:09.856982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:09.857583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:09.863753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.864227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:09.865042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:09.865481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.234156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:10.241884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3018412f-748c-41c3-91d3-741cf171bd80 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1514 microversion: 2.1 time: 0.388733 May 16 16:59:10.242454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 180/355] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:09 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:10.378989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:10.379609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:10.387281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.387754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.388529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.388958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.504359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-86441e5b-cfc7-48d6-96e9-cd6762fdef14 req-6dcd38c5-112d-4609-8464-bd5074a541bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c2033c-4fee-4884-a6f7-de043836ebad", "tag": "fd7ba01c-f563-4085-b558-b1c5bd0db5a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:10.513568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-86441e5b-cfc7-48d6-96e9-cd6762fdef14 req-6dcd38c5-112d-4609-8464-bd5074a541bc service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.514313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-86441e5b-cfc7-48d6-96e9-cd6762fdef14 req-6dcd38c5-112d-4609-8464-bd5074a541bc service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.532213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-86441e5b-cfc7-48d6-96e9-cd6762fdef14 req-6dcd38c5-112d-4609-8464-bd5074a541bc service nova] Creating event network-changed:fd7ba01c-f563-4085-b558-b1c5bd0db5a6 for instance d5c2033c-4fee-4884-a6f7-de043836ebad on hv-cinder-83998 May 16 16:59:10.540082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-86441e5b-cfc7-48d6-96e9-cd6762fdef14 req-6dcd38c5-112d-4609-8464-bd5074a541bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039320 May 16 16:59:10.540708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 181/356] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:59:10.542741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:10.553510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bbbf3449-503d-4f37-a3e7-64af2ee08a73 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.177876 May 16 16:59:10.558204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 176/357] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:10.698986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:10.699609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:10.706191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.706650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.707432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.707908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.823388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:10.824001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:10.830048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.830715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.831485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:10.831915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:10.871328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:10.880320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:10.882165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:10.883749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5bd664e3-3e19-4dbe-9924-9b4908bab013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1745 microversion: 2.20 time: 0.190302 May 16 16:59:10.884853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 182/358] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:10.916979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:10.924345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-83153d54-3f85-4c42-a9dc-fd7e8e61acc7 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1283 microversion: 2.1 time: 0.104733 May 16 16:59:10.924929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 177/359] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:10 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:11.572055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:11.573139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:11.581658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.582189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.582971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.583577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.675553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:11.677437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:11.696165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.696618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.697560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.698015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.735965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lazy-loading 'flavor' on Instance uuid 511490fe-b0f9-40b5-ac21-4ca092e7e4ee {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:59:11.834654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:11.846021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-58a6c41d-5ed9-46f4-880a-090ace066725 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.278822 May 16 16:59:11.856541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 183/360] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:11.873993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-054394eb-87bc-4fbd-9f2b-7ac8efbd3794 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/action" status: 200 len: 32 microversion: 2.1 time: 0.204964 May 16 16:59:11.874724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 178/361] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 16:59:11 2022] POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 16:59:11.883922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:11.884806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:11.891644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.892356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.893328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.894047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.904588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:11.905629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:11.914110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.914877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:11.915882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:11.916329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:12.131216 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:12.138704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d6f7ae3c-2fd9-42b7-a1e0-3f035fe45dfa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.258578 May 16 16:59:12.149696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 184/362] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:11 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:12.155992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:12.165097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:12.166426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:12.166716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:12.169045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:12.171393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ea84fa96-dfd8-4aeb-aa4a-a1fac2b70fdf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1745 microversion: 2.20 time: 0.271811 May 16 16:59:12.172525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 179/363] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1745 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:12.174790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:12.175234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:12.176566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:12.177447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:12.454266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:12.462870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-93b98602-ff2f-4d9c-b245-65f747642169 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.311388 May 16 16:59:12.466205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 185/364] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:12 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:12.829410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-6bea304e-e1c2-4c98-8fea-2fb7328acec5 req-3287a1e7-f627-4d59-aaee-ec8ce7f59f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fc33a1-a49e-40bf-9068-21bfcef36f09", "tag": "8a06c5bf-7188-4864-b174-91aa43e83092"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:12.837698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-6bea304e-e1c2-4c98-8fea-2fb7328acec5 req-3287a1e7-f627-4d59-aaee-ec8ce7f59f57 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:12.838254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-6bea304e-e1c2-4c98-8fea-2fb7328acec5 req-3287a1e7-f627-4d59-aaee-ec8ce7f59f57 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:12.850412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-6bea304e-e1c2-4c98-8fea-2fb7328acec5 req-3287a1e7-f627-4d59-aaee-ec8ce7f59f57 service nova] Creating event network-changed:8a06c5bf-7188-4864-b174-91aa43e83092 for instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 on hv-cinder-83998 May 16 16:59:12.856474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-6bea304e-e1c2-4c98-8fea-2fb7328acec5 req-3287a1e7-f627-4d59-aaee-ec8ce7f59f57 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030409 May 16 16:59:12.857413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 180/365] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:12.864414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:12.865616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:12.875359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:12.875804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:12.876566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:12.876993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.016921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:13.025112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-56d6fbae-2df4-4f17-9adb-a94cedad783f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.164871 May 16 16:59:13.025754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 186/366] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:13.160811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:13.161547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:13.168091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:13.168540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.169311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:13.169759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.190372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:13.191736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:13.199464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:13.200111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.201569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:13.202752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.300161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:13.312272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4cfcd812-4cae-43e0-8dcf-380681f2ae92 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.155551 May 16 16:59:13.312868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 181/367] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:13 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:13.408703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:13.415202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:13.416798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:13.418020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5c65204c-9f6a-47f2-82be-0e170386fa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1745 microversion: 2.20 time: 0.232237 May 16 16:59:13.418574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 187/368] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1745 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:13.480248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:13.480855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:13.486893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:13.487340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.488101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:13.488529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:13.616998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:13.624244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7688f988-c641-4397-9990-637d7a4912e5 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.147713 May 16 16:59:13.624832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 182/369] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:13 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:14.042422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:14.043154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:14.049676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.050156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.050929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.051363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.197145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:14.205431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cbab6f8f-5d86-44cb-bf6b-a6c8297d5536 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.166977 May 16 16:59:14.206059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 188/370] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:14.330094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:14.330711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:14.337818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.338273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.339229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.339827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.370492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-d3254cda-59be-46bd-98cd-db9d479c7573 req-ce9b1032-99cb-4582-b418-c5fc4abffb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "name": "network-vif-plugged", "status": "completed", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:14.381539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-d3254cda-59be-46bd-98cd-db9d479c7573 req-ce9b1032-99cb-4582-b418-c5fc4abffb04 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.382139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-d3254cda-59be-46bd-98cd-db9d479c7573 req-ce9b1032-99cb-4582-b418-c5fc4abffb04 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.395040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-d3254cda-59be-46bd-98cd-db9d479c7573 req-ce9b1032-99cb-4582-b418-c5fc4abffb04 service nova] Creating event network-vif-plugged:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 16:59:14.401987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-d3254cda-59be-46bd-98cd-db9d479c7573 req-ce9b1032-99cb-4582-b418-c5fc4abffb04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035088 May 16 16:59:14.402906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 189/371] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:59:14.436849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:14.437698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:14.444784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.445344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.446284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.446818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.476579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:14.484107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-603ab95c-a467-4111-ad2f-773e6f2bb4af tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.157800 May 16 16:59:14.484676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 183/372] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:14 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:14.581685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:14.592705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:14.593950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:14.595165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-81aa0ddc-6862-4dab-b979-452f5093ffd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1745 microversion: 2.20 time: 0.162621 May 16 16:59:14.595736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 190/373] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:14.641453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:14.642097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:14.648185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.648638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.649436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:14.649909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:14.781073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:14.789033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d921a407-6d31-4cc4-93de-67e3f4d980ea tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.151425 May 16 16:59:14.789594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 184/374] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:14 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:15.223307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:15.224190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:15.230574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.231014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.231767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.232195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.364373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:15.372037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a8c0bc0a-f8cf-4ad6-a8fa-b177f508245c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.152586 May 16 16:59:15.372597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 191/375] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:15.501614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:15.502196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:15.508599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.509049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.509853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.510294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.615401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:15.615401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:15.632851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.633308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.634205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.634589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.640547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:15.649328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b5dc4af5-4128-4a69-8895-5816a92c9e73 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.151759 May 16 16:59:15.659182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 185/376] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:15 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:15.776728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:15.784855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:15.786408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:15.787629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61c90045-573f-4173-a2f2-8c8e4f911f00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1745 microversion: 2.20 time: 0.177648 May 16 16:59:15.788194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 192/377] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:15.808250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:15.808871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:15.814936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.815401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.816181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:15.816620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:15.961614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:15.969610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-678cc9ca-8434-440c-b1d3-228f85e6f5cd tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.167650 May 16 16:59:15.979363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 186/378] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:15 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:16.388942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:16.390473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:16.398115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.398828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.399668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.400490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.556660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:16.565073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0933c9e2-f8df-4c41-bd20-b12c08ff3c9f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.179904 May 16 16:59:16.565661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 193/379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:16.667143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:16.667763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:16.674723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.675255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.676273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.676803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.808816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:16.809471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:16.822829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.823563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.824606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.825199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.866323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:16.874460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f1442cfa-fcdd-4e0d-be95-946e3beff3fb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.211886 May 16 16:59:16.875763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 187/380] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:16 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:16.987885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:16.989510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:16.997770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:16.998688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:16.999655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:17.000327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:17.015709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:17.026014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:17.027895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:17.029295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d6812f38-27f2-4e84-9ab5-f37e2786fa44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.225568 May 16 16:59:17.030436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 194/381] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:17.188568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:17.196819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7fdf0421-5db9-4b6d-9b1f-a1894c4567de tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.213755 May 16 16:59:17.209078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 188/382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:16 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:17.583130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:17.584475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:17.590660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:17.591201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:17.592044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:17.592559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:17.748848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:17.760026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b63e5d62-d05a-41b0-9fbb-934e20d8c14b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1725 microversion: 2.1 time: 0.181198 May 16 16:59:17.760625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 195/383] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:17.894164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:17.895366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:17.902829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:17.903620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:17.904774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:17.905351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.053731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:18.054577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:18.064029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.065690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.066710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.068235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.150555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:18.163415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-02c27fb0-2b2f-4bec-85f4-ab2c7f9bf437 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.274583 May 16 16:59:18.177977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 189/384] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:17 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:18.215658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:18.216281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:18.225192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.225641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.226476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.227001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.257152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:18.273984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:18.278224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:18.279531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a671c82c-35b7-4a5f-a104-1fd945f21ac7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.230271 May 16 16:59:18.286669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 196/385] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:18.431310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:18.439125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f6fe4c3-adf3-4623-9fcd-fee6a2d49167 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.228176 May 16 16:59:18.440244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 190/386] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:18 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:18.776380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:18.776929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:18.783054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.783520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.784298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.784733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:18.930458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:18.962625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0e3e4f58-a180-4a7e-9307-43bc8641d75c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1702 microversion: 2.1 time: 0.189989 May 16 16:59:18.973145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 197/387] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1702 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:18.980529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4047364e-d077-48d4-8a13-828e77b8c6b9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:18.990206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4047364e-d077-48d4-8a13-828e77b8c6b9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:18.990698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4047364e-d077-48d4-8a13-828e77b8c6b9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.057706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4047364e-d077-48d4-8a13-828e77b8c6b9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Going to try to start instance {{(pid=117183) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 16:59:19.127687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4047364e-d077-48d4-8a13-828e77b8c6b9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/action" status: 202 len: 0 microversion: 2.1 time: 0.150894 May 16 16:59:19.132272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 191/388] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 16:59:18 2022] POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 16:59:19.139223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:19.140629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:19.152205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.161152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.163441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.164320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.200924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:19.201639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:19.220153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.220600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.221383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.221844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.441126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:19.441311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:19.448730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d735a40f-d7b5-4320-9e68-543c3934934b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.271435 May 16 16:59:19.451412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 192/389] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:19 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:19.455973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:19.456579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:19.464427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1a11fe6a-e3a0-47aa-9aae-02e54b01da16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1711 microversion: 2.1 time: 0.326838 May 16 16:59:19.464427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 198/390] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1711 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:19.468392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:19.468392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:19.473172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.473625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.475348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.475788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.486762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.487217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.488003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:19.488440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:19.689463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:19.698627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:19.700184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:19.701755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-88f11a23-fc4a-4dac-abb9-5a98001e4026 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.249025 May 16 16:59:19.702580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 193/391] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:19.754370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:19.762397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5ee221ab-eb8c-443a-9a6b-749dbe6d4d22 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.299495 May 16 16:59:19.772948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 199/392] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:19 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:20.464838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:20.466179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:20.473919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.474416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.475195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.475638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.486067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:20.486672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:20.505181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.506212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.506992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.507428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.656559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:20.668937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5014b547-8e7d-417c-b68f-d76c37d68bfe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.207916 May 16 16:59:20.680209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 194/393] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:20 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:20.689896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:20.700635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-23d604ca-ddcb-4c1b-8a18-92ecbee17236 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1711 microversion: 2.1 time: 0.219415 May 16 16:59:20.702444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 200/394] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1711 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:20.727031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-7a1baf61-4997-48bb-93ee-7eca94a6112f req-fe3acbd8-31ad-4151-a24a-09c85b7613ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fc33a1-a49e-40bf-9068-21bfcef36f09", "name": "network-vif-plugged", "status": "completed", "tag": "8a06c5bf-7188-4864-b174-91aa43e83092"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:20.727291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:20.727730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:20.735971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.736419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.737196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.737628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.749269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-7a1baf61-4997-48bb-93ee-7eca94a6112f req-fe3acbd8-31ad-4151-a24a-09c85b7613ba service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.750121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-7a1baf61-4997-48bb-93ee-7eca94a6112f req-fe3acbd8-31ad-4151-a24a-09c85b7613ba service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.774522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-7a1baf61-4997-48bb-93ee-7eca94a6112f req-fe3acbd8-31ad-4151-a24a-09c85b7613ba service nova] Creating event network-vif-plugged:8a06c5bf-7188-4864-b174-91aa43e83092 for instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 on hv-cinder-83998 May 16 16:59:20.782325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-7a1baf61-4997-48bb-93ee-7eca94a6112f req-fe3acbd8-31ad-4151-a24a-09c85b7613ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058671 May 16 16:59:20.783304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 201/395] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 16:59:20.790377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:20.791088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:20.798649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.799104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.799898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:20.800360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:20.912654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:20.921184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:20.927859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:20.933850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-66dc759d-9f01-41f8-b50d-0dc4bdc5aadc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.213811 May 16 16:59:20.934443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 195/396] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:20.993162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:21.001066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d7ba4fb-9149-40db-b439-9e38df00a048 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.216119 May 16 16:59:21.001645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 202/397] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:20 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:21.686896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:21.687435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:21.694219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:21.694667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:21.695430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:21.695873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:21.718890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:21.719508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:21.726057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:21.726516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:21.727285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:21.727722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:21.825763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:21.835322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-17377ea7-fbcb-47ad-8815-edf5edb386a8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.152207 May 16 16:59:21.835900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 196/398] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:21 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:21.862825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:21.870499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f5908ecc-8012-423f-850b-fc912678bb05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1715 microversion: 2.1 time: 0.155413 May 16 16:59:21.871081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 203/399] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:21.953687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:21.954268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:21.960504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:21.960960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:21.961753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:21.962367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:22.020253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:22.020954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:22.026922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:22.027441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:22.028203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:22.028630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:22.100581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:22.110621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:22.112138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:22.113302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-136ecd46-c346-4eb2-87bf-4ccdcb795e0f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.164826 May 16 16:59:22.124168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 197/400] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:22.183601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:22.192650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3e8b2026-4451-49e2-a50f-d9f4044334e4 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.176065 May 16 16:59:22.194006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 204/401] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:22 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:22.853062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:22.854409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:22.860878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:22.861362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:22.862162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:22.862607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:23.003822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:23.012792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce785260-c228-4bf8-ab25-f6f8a840063f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.164262 May 16 16:59:23.013800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 198/402] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:22 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:23.134055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:23.135117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:23.142921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:23.143678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:23.145050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:23.145625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:23.212600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:23.217032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:23.238249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:23.238690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:23.239771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:23.240201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:23.347794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:23.360183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:23.363787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:23.366566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-75f4c584-caf7-4492-b678-d000cf5bd426 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.237926 May 16 16:59:23.367861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 205/403] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:23.456637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:23.465096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e4139a60-6f00-4a8e-bd21-a3e3b057b9e0 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1313 microversion: 2.1 time: 0.258369 May 16 16:59:23.465851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 199/404] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:23 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:24.036207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:24.037350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:24.043915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.044403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.045185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.045714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.198642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:24.207814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e9fabaa8-d2de-419c-8ce7-d42a9c170c2c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.177455 May 16 16:59:24.214034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 206/405] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:24 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:24.261844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9659201-3396-4ba3-a2ad-2b630486a475", "device": "/dev/sdb"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:24.263647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:24.270513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.271512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.272294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.272735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.393858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:24.394634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:24.402149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.402966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.404017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.404708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.554408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:24.562749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:24.564267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:24.565504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8b502c8c-3dd3-402d-99c4-16804f145bd7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.175570 May 16 16:59:24.577127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 207/406] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:24.583126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:24.584546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:24.592051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.592798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.594023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:24.594633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:24.807593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-360c0d60-7fed-48e3-887a-54e8329867fc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "POST /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549656 May 16 16:59:24.809584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:24.812777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 200/407] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 16:59:24 2022] POST /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:24.822591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a7e54f61-800d-4f95-9e80-baed91fdab96 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1497 microversion: 2.1 time: 0.242413 May 16 16:59:24.832468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 208/408] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:24 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:25.227725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:25.228696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:25.237381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:25.238235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:25.242653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:25.243580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:25.394857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:25.414830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-89c8f8b2-3701-4695-9184-5593760c53a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.192466 May 16 16:59:25.434874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 201/409] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:25 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:25.585425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:25.586156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:25.592849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:25.593320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:25.594147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:25.594747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:25.737033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:25.745984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:25.747742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:25.748898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bec8372c-ac2b-4af3-ac86-2fe2d85c1554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.168499 May 16 16:59:25.749961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 209/410] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:25.858884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:25.859622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:25.869759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:25.870368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:25.871425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:25.871924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:25.900395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 16:59:26.001704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5eda5877-eadb-4b5c-a167-820c1fd4ca1c tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "DELETE /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 204 len: 0 microversion: 2.1 time: 0.146382 May 16 16:59:26.003007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 202/411] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 16:59:25 2022] DELETE /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 16:59:26.012344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:26.019196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:26.027227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:26.027872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:26.029177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:26.029906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:26.173325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:26.181698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5df962ca-60d2-4728-8d94-1acb32460f32 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1503 microversion: 2.1 time: 0.173455 May 16 16:59:26.182781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 210/412] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:26 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:26.464518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:26.465254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:26.471558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:26.472006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:26.472764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:26.473227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:26.602055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:26.609246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b23290f8-382f-4b5e-b776-47c6ea1b6c22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.148894 May 16 16:59:26.609838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 203/413] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:26 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:26.767301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:26.767931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:26.774777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:26.775221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:26.775976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:26.776464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:26.904299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:26.911998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:26.913492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:26.914666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-42fcbffb-c3ed-41fd-8de7-9b3ccc463974 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.151275 May 16 16:59:26.915229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 211/414] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:27.199335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:27.199952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:27.205816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:27.206268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:27.207048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:27.207466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:27.329879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:27.337066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f9005e51-87c2-4ee5-81ed-3c27eae6312e tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1503 microversion: 2.1 time: 0.141533 May 16 16:59:27.337639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 204/415] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:27 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1503 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:27.626784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:27.627397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:27.633303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:27.633783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:27.634552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:27.634988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:27.760178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:27.767307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bb3ab788-c9c6-4cfd-97c0-c6577a37a304 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.144409 May 16 16:59:27.767865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 212/416] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:27 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:27.932855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:27.933398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:27.939782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:27.940230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:27.940986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:27.941421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:28.072297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:28.080005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:28.081508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:28.083899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6edc6bdd-58ea-498c-a639-8f8622d9ae45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1740 microversion: 2.20 time: 0.154310 May 16 16:59:28.084733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 205/417] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:28.353862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:28.354467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:28.360711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:28.361156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:28.361930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:28.362358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:28.492051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:28.500407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a5fe131e-69f1-4f8f-a248-8749fda858bc tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1503 microversion: 2.1 time: 0.150354 May 16 16:59:28.501605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 213/418] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:28 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:28.784506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:28.785061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:28.791608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:28.792062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:28.792831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:28.793271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:28.920971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:28.928189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-61153c6c-d20e-4a14-afe0-0595a51f705c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.147702 May 16 16:59:28.928754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 206/419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:28 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:29.101433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:29.102021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:29.107739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.108186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:29.108945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.109378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:29.233205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:29.240923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:29.242443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:29.243592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ba60dd8e-7762-4c4a-8fcc-ca9f3e428918 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.146392 May 16 16:59:29.244144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 214/420] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:29.518500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:29.519117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:29.525350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.525828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:29.526608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.527060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:29.652773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6866ee078cd54f469aa188209fac9b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860206f7b662414ca56ef58314ad4a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:29.660190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7486789d-a691-44a5-93d9-29d3140fb980 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 200 len: 1503 microversion: 2.1 time: 0.145640 May 16 16:59:29.660773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 207/421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:29 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:29.762133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-b15cb1cf-1350-4321-9bdf-62c53c14e1a4 req-474dc7a9-519d-491c-89d4-1613817fffbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fc33a1-a49e-40bf-9068-21bfcef36f09", "name": "network-vif-deleted", "tag": "8a06c5bf-7188-4864-b174-91aa43e83092"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:29.770521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b15cb1cf-1350-4321-9bdf-62c53c14e1a4 req-474dc7a9-519d-491c-89d4-1613817fffbb service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.770962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b15cb1cf-1350-4321-9bdf-62c53c14e1a4 req-474dc7a9-519d-491c-89d4-1613817fffbb service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:29.781609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-b15cb1cf-1350-4321-9bdf-62c53c14e1a4 req-474dc7a9-519d-491c-89d4-1613817fffbb service nova] Creating event network-vif-deleted:8a06c5bf-7188-4864-b174-91aa43e83092 for instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 on hv-cinder-83998 May 16 16:59:29.786943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-b15cb1cf-1350-4321-9bdf-62c53c14e1a4 req-474dc7a9-519d-491c-89d4-1613817fffbb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028009 May 16 16:59:29.787509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 215/422] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:29.945409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:29.946121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:29.952247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.952621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:29.953395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:29.957990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:30.140089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:30.149437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-666a2d4a-1ec6-4b60-8e50-259c968b5871 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.208815 May 16 16:59:30.158783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 208/423] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:29 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:30.261382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:30.262180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:30.268150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:30.268669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:30.269533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:30.270065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:30.631220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:30.639334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:30.640966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:30.642302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-16a55005-1b64-4aff-af65-0f4e1f38853e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.385197 May 16 16:59:30.654036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 216/424] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:30.678672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:30.679415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] [instance: 46fc33a1-a49e-40bf-9068-21bfcef36f09] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:30.686907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:30.687362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:30.688177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:30.688800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:30.702938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] HTTP exception thrown: Instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 could not be found. May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Request method failure captured: May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 HTTP/1.1 May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoLDMzuf0tjfqSlcW3MBOx1ycnQzt80yCQYm-dti246F4CxJCzcbQOnJAQxbCykXa7h7ZBRsQrd1UJ7efhmhgtfixtsNPjIXx12n7lO8smFNxJQtT2taXoRhUs3EvLdwdZieOI6JwrJTG0kVlr4WUzd63Qd4qz_4WigShWGPhLh5ZB8 May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 860206f7b662414ca56ef58314ad4a5a May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesActionsTest-1611832481 May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 16:59:30.704628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/860206f7b662414ca56ef58314ad4a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesActionsTest-1611832481 May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 860206f7b662414ca56ef58314ad4a5a May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesActionsTest-1611832481 May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesActionsTest-1611832481-project May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 6866ee078cd54f469aa188209fac9b95 May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesActionsTest-1611832481-project May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 could not be found. May 16 16:59:30.706311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '46fc33a1-a49e-40bf-9068-21bfcef36f09'} May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 could not be found. May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:59:30.707178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 could not be found. May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 could not be found. May 16 16:59:30.709236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:30.710919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] Returning 404 to user: Instance 46fc33a1-a49e-40bf-9068-21bfcef36f09 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:59:30.710919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bcb93119-02e8-42a4-adf0-6b3d76588869 tempest-VolumesActionsTest-1611832481 tempest-VolumesActionsTest-1611832481-project] 10.222.0.70 "GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09" status: 404 len: 111 microversion: 2.1 time: 0.032954 May 16 16:59:30.712855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 209/425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:30 2022] GET /compute/v2.1/servers/46fc33a1-a49e-40bf-9068-21bfcef36f09 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 16:59:31.165969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:31.166590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:31.172782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:31.173293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:31.174085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:31.174526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:31.307388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:31.319993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c238fa1e-93b1-44e7-9f21-d4993f206c42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.157464 May 16 16:59:31.320613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 217/426] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:31 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:31.661932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:31.662554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:31.668450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:31.668901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:31.669664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:31.670131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:31.794764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:31.802377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:31.803877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:31.805021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8fdbb3f2-013f-4d0f-8c19-db66ee622c31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.147553 May 16 16:59:31.805583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 210/427] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:32.338009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:32.338618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:32.344847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:32.345296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:32.346099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:32.346533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:32.479687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:32.486911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-904dc0f6-0510-4e24-8c18-1c6c691256ac tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.152834 May 16 16:59:32.487474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 218/428] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:32 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:32.823188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:32.823798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:32.830082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:32.830533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:32.831296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:32.831731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:32.954222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:32.965276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:32.966810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:32.967966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1dc38805-237d-4fe7-83e1-0674131cefc9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.148723 May 16 16:59:32.968525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 211/429] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:33.503894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:33.504504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:33.511418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:33.511893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:33.512652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:33.513086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:33.640031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:33.647452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c4523fca-f8ae-4b08-9279-c953aead4254 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.147300 May 16 16:59:33.648023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 219/430] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:33 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:33.694970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-06e741e9-7f50-4d4f-891f-afe94622f387 req-9f5e9b58-4950-4338-9dbe-77a4b3ee41c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "name": "network-vif-unplugged", "status": "completed", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:33.703069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-06e741e9-7f50-4d4f-891f-afe94622f387 req-9f5e9b58-4950-4338-9dbe-77a4b3ee41c0 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:33.703513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-06e741e9-7f50-4d4f-891f-afe94622f387 req-9f5e9b58-4950-4338-9dbe-77a4b3ee41c0 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:33.714223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-06e741e9-7f50-4d4f-891f-afe94622f387 req-9f5e9b58-4950-4338-9dbe-77a4b3ee41c0 service nova] Creating event network-vif-unplugged:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 16:59:33.719182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-06e741e9-7f50-4d4f-891f-afe94622f387 req-9f5e9b58-4950-4338-9dbe-77a4b3ee41c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027899 May 16 16:59:33.719760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 212/431] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:33.988286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:33.989196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:33.995274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:33.995719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:33.996495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:33.996908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:34.123918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:34.132096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:34.133577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:34.134751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f7845ed7-e803-4bf3-a829-676ae4f37111 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.151490 May 16 16:59:34.135343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 220/432] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:34.665097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:34.665875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:34.672413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:34.672861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:34.673887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:34.674318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:34.804280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:34.811417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce208f33-056f-4120-bb4d-0cb18454e140 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.151063 May 16 16:59:34.811984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 213/433] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:34 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:35.152680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:35.153328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:35.160138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:35.160587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:35.161980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:35.162420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:35.291295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:35.298906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:35.300392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:35.301534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3ed5be93-3b5f-45dc-91ea-a883e45f466e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.152819 May 16 16:59:35.302772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 221/434] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:35.828187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:35.828820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:35.835885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:35.836332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:35.837085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:35.837517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:35.959583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:35.967267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-00b528cd-c2b6-4021-9629-5cb992c50b22 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.142891 May 16 16:59:35.967837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 214/435] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:35 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:36.321038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:36.321580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:36.327870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:36.328316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:36.329072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:36.329505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:36.456869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:36.464492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:36.466005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:36.467133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-62f330c2-3bc6-47df-b6d3-c5c99b8681f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.150700 May 16 16:59:36.467688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 222/436] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:36.985801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:36.986350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:36.992717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:36.993157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:36.993965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:36.994397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:37.120457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:37.127677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0f0791ac-99d8-4099-b5fc-00bb7d68f873 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.145813 May 16 16:59:37.128246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 215/437] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:36 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:37.485428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:37.486066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:37.492367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:37.492824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:37.493578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:37.494042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:37.620001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:37.627697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:37.629205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:37.630900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4bdbc2ea-0bd7-41ad-b06b-58b56e68bd32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.149368 May 16 16:59:37.631454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 223/438] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:38.144350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:38.144986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:38.151332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:38.151791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:38.152559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:38.152997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:38.277784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:38.285045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f0e834f-230a-4124-8e02-431b56cabf23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.144493 May 16 16:59:38.285612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 216/439] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:38 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:38.648740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:38.649358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:38.655622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:38.656077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:38.656863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:38.657303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:38.782057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:38.789749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:38.791263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:38.792412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da473d5d-e4bc-4532-b40c-1ab719a36650 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.148074 May 16 16:59:38.792973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 224/440] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:39.302814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:39.303475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:39.309877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:39.310391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:39.311205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:39.311701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:39.445501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:39.453018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-66935645-93b8-4a36-ba6b-591af8e34cc7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.154561 May 16 16:59:39.453586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 217/441] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:39 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:39.813688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:39.814266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:39.820495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:39.820946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:39.821711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:39.822169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:39.948985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:39.956550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:39.958567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:39.959701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ee11ba46-934f-4765-b916-f7482dffaa66 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1722 microversion: 2.20 time: 0.149881 May 16 16:59:39.960258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 225/442] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:40.470265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:40.470880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:40.477420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:40.477908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:40.478698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:40.479114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:40.643874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:40.652666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cd87ff62-eb2e-4de5-976b-1a8d70611c7c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.186194 May 16 16:59:40.653728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 218/443] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:40 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:40.978531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:40.979297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:40.990751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:40.991480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:40.992276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:40.992711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.119202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.126810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.128330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.129442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f110117d-c3dd-4978-9c68-ee5eae32ce73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1665 microversion: 2.20 time: 0.154792 May 16 16:59:41.130540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 226/444] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:41.147918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97758427-fbfd-470e-bfef-84f94db93a55"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:41.148941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:41.155030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.155520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.156301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.156744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.416622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fc6acb1c-9935-4302-938e-88a5880e1d0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273263 May 16 16:59:41.417232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 219/445] 10.222.0.70 () {62 vars in 1363 bytes} [Mon May 16 16:59:41 2022] POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 16:59:41.526846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:41.527434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:41.533183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.533634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.534433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.534872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.623840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe8618f1-a594-4b43-880b-f2b6a526cbdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/action" status: 202 len: 0 microversion: 2.20 time: 0.100792 May 16 16:59:41.624449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 227/446] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 16 16:59:41 2022] POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 16:59:41.632430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:41.633038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:41.640155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.640629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.641398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.641847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.670099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:41.670757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:41.676962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.677418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.678235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:41.678676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:41.787638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.796070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.797554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.798739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8b5b8537-006c-4bd6-a35f-e6583dacec44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1751 microversion: 2.20 time: 0.170258 May 16 16:59:41.799480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 220/447] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:41.814771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:41.822499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-904945b4-524b-48b6-89a4-2589bf8b7ea5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.156581 May 16 16:59:41.823113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 228/448] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:41 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:42.816350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:42.816887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:42.823162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:42.823638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:42.824402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:42.824838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:42.838901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:42.839514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:42.845833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:42.846285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:42.847051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:42.847490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:42.948479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:42.956665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:42.958702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:42.959867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-17a8704e-269b-4f70-a2de-8b9fd1b8c44b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1751 microversion: 2.20 time: 0.147485 May 16 16:59:42.960433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 221/449] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:42.978323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:42.985574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-42ca66e1-cf7f-46bf-86c1-c130083d6e1f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.150486 May 16 16:59:42.986175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 229/450] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:42 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:43.978487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:43.979090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:43.985337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:43.985809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:43.986565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:43.986994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:44.002185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:44.002796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:44.009628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:44.010112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:44.010881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:44.011313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:44.112853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:44.121559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:44.123076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:44.124231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-38357caf-b125-4203-9635-bfbb6ccb1fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1751 microversion: 2.20 time: 0.149667 May 16 16:59:44.124791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 222/451] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:44.140294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:44.147504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9279b512-a9b0-406d-9c06-8a4e2b1cebb4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.149099 May 16 16:59:44.148054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 230/452] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:43 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:45.143507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:45.144714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:45.151881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:45.152739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:45.153768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:45.154265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:45.164996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:45.170995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:45.185019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:45.186744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:45.189230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:45.192957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:45.479014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:45.490549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0b94fac5-ebe9-4571-8675-cb8f3a44a229 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.329973 May 16 16:59:45.491456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 231/453] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:45 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:45.496386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:45.519128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:45.525095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:45.527035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e1924fd-5ef3-4b6b-996a-9bac23595711 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1751 microversion: 2.20 time: 0.388224 May 16 16:59:45.529432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 223/454] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1751 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:46.511753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:46.512599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:46.520641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:46.521018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:46.521815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:46.522250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:46.549300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:46.550060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:46.557171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:46.557979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:46.558952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:46.559573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:46.697166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:46.707236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f0287b12-7ca2-4a91-8fac-ce42748438a2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.200820 May 16 16:59:46.708680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 232/455] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:46 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:46.725801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:46.736568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:46.738118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:46.739390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-393da75f-bad1-49f4-8ee7-dccee56363a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1753 microversion: 2.20 time: 0.195013 May 16 16:59:46.745778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 224/456] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 16:59:47.726241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:47.726953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:47.735188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:47.735660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:47.736436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:47.736879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:47.759081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:47.760392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:47.768667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:47.769345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:47.770576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:47.771506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:47.948264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:47.964328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe1b5e32-d43d-4260-8152-591936908da6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1500 microversion: 2.1 time: 0.242120 May 16 16:59:47.964928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 233/457] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:47 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1500 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:47.982294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0418ae67-e9ae-49af-894c-ec95836fea14"}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:47.983857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:47.995236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.003787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.019173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.021614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.061038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] HTTP exception thrown: Cannot 'attach_volume' instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee while it is in vm_state rescued May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Request method failure captured: May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/os-volume_attachments HTTP/1.1 May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 74 May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoKVrQRcYUG-VB_avmME8Bs8H7ZlGXfecyfltRxDOQzLqnt3OwRWzogIBKrh0Swq0gD7zHiCwuph7WGgsaJbjGOcgf5FrnXr16sjzCUzuDCD8SXuqcHdXLE14xP6cCmAFMrpF0GkblF5QUv8nk-gfefDO0J7rFtZ5XADpNHnEnmooMM May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: d288b61a6379415c9f773fc61950f570 May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-734861323 May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 16:59:48.063372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d288b61a6379415c9f773fc61950f570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d288b61a6379415c9f773fc61950f570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d288b61a6379415c9f773fc61950f570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d288b61a6379415c9f773fc61950f570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-ServerRescueNegativeTestJSON-734861323 May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: d288b61a6379415c9f773fc61950f570 May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-734861323 May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-ServerRescueNegativeTestJSON-734861323-project May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 673ff42fb9454adf93be94f46e60755a May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-ServerRescueNegativeTestJSON-734861323-project May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {"volumeAttachment": {"volumeId": "0418ae67-e9ae-49af-894c-ec95836fea14"}} May 16 16:59:48.064858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Cannot 'attach_volume' instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee while it is in vm_state rescued May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'server_id': '511490fe-b0f9-40b5-ac21-4ca092e7e4ee', 'body': {'volumeAttachment': {'volumeId': '0418ae67-e9ae-49af-894c-ec95836fea14'}}} May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:59:48.065761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee while it is in vm_state rescued May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:48.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:48.068507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:59:48.068507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:59:48.068507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee while it is in vm_state rescued May 16 16:59:48.068507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 16:59:48.068507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Returning 409 to user: Cannot 'attach_volume' instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee while it is in vm_state rescued {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:59:48.068507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1bdafc33-8925-46bb-8121-ea24cbe6f8eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090686 May 16 16:59:48.072249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 234/458] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 16:59:47 2022] POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 16:59:48.081436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:48.084016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:48.102257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.106110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.113015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.116949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.279472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:48.291674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:48.293657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:48.296256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6aca5ff8-d67c-46eb-8658-c401ac16c70b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1753 microversion: 2.20 time: 0.541883 May 16 16:59:48.297627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 225/459] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1753 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:48.319113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-23c974d5-258a-4030-9a42-b31d308c4de1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/action" status: 202 len: 0 microversion: 2.1 time: 0.245204 May 16 16:59:48.322841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 235/460] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 16:59:48 2022] POST /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 16:59:48.328055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:48.328925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:48.336849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.337559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.338533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.339129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.485692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:48.495322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9a23fd60-4f4b-4846-a944-3bdf2fbe5cee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.171067 May 16 16:59:48.496658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 226/461] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:48 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:48.537858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:48.538759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:48.546083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.546896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.547885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:48.548320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:48.702366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'services' on Instance uuid 81d63564-f586-464a-9794-cd3ab451b3aa {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:59:48.850559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bd03d8cd-98ae-4ae0-83ea-300c4d1a3d19 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa/os-volume_attachments/b9659201-3396-4ba3-a2ad-2b630486a475" status: 202 len: 0 microversion: 2.1 time: 0.319727 May 16 16:59:48.851296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 236/462] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 16:59:48 2022] DELETE /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa/os-volume_attachments/b9659201-3396-4ba3-a2ad-2b630486a475 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 16:59:49.314686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:49.316082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:49.323470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:49.324004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:49.324874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:49.325381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:49.465776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:49.476057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:49.478234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:49.479619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-280487c0-2ca8-4f22-877a-a7686cdebe8b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1753 microversion: 2.20 time: 0.168906 May 16 16:59:49.480629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 227/463] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:49.516609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:49.517578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:49.527122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:49.528165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:49.529494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:49.530060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:49.681868 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:49.689613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9f5a24e0-f01d-49ce-bdbc-5cdc90708f6d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.179271 May 16 16:59:49.690707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 237/464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:49 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:50.500310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:50.502162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:50.511658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:50.514016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:50.515189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:50.515906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:50.695921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:50.704287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:50.705822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:50.706998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f34b27f0-f3bf-4e9f-b5cd-b65feaa5e73d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.212058 May 16 16:59:50.707610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 228/465] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:50.708492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:50.709108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:50.715650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:50.716095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:50.716857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:50.717430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:50.856599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:50.868188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-25e1a917-8f7b-43c6-bd6a-ea27f3577f30 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.163683 May 16 16:59:50.868940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 238/466] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:50 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:51.038918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:51.039441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:51.048744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.049302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.050283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.052336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.079792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 16:59:51.173428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-351db1f0-975c-4249-a14f-80700a73ed70 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 204 len: 0 microversion: 2.1 time: 0.138567 May 16 16:59:51.175012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 229/467] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 16:59:51 2022] DELETE /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 16:59:51.190906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:51.193384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:51.200869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.201279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.202097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.202544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.365442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:51.392183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d9dd7f44-981c-4671-a652-c103798cbe0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1558 microversion: 2.1 time: 0.212170 May 16 16:59:51.393213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 239/468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:51 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:51.725516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:51.727155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:51.734155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.734838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.735942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.736588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.889917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:51.890840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:51.895601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:51.899596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.900047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.901032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:51.901577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:51.905061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:51.906613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:51.909131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7d134f5c-61cc-4d2f-99b7-27f3d04bac13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.187278 May 16 16:59:51.910184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 230/469] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:52.048056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:52.056620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-67a65e95-9469-44c2-8fb5-b94e92daa62c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.172282 May 16 16:59:52.057450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 240/470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:51 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:52.417292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:52.418188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:52.430042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:52.431108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:52.432979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:52.433947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:52.606899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:52.615654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-547e39c7-2135-441d-9237-31f443fd027a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1558 microversion: 2.1 time: 0.208695 May 16 16:59:52.616409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 231/471] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:52 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:52.928672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:52.929311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:52.942249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:52.943205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:52.943990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:52.944429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:53.077777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:53.078398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:53.089725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:53.090197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:53.091032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:53.091428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:53.128014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:53.136744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:53.138193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:53.139369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cd1d59c7-e8b1-4d43-86d6-8785ac5c5d1e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.215369 May 16 16:59:53.150686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 241/472] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:53.254678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:53.262167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2a5d007c-d790-4f54-abfa-4e1e0100ae42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.191527 May 16 16:59:53.262830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 232/473] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:53 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:53.632286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:53.633084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:53.639533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:53.640104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:53.640971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:53.641511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:53.781439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:53.789148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1e110291-8856-4c6c-939b-1f4be2a66171 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1512 microversion: 2.1 time: 0.160636 May 16 16:59:53.789940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 242/474] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:53 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:54.158066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:54.158850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:54.165789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:54.166242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:54.167011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:54.167628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:54.279295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:54.280770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:54.289191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:54.291124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:54.293031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:54.293656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:54.312817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:54.322030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:54.325364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:54.326744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5b632d56-358e-4dad-bb71-8556f6bc3d5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.172739 May 16 16:59:54.327720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 233/475] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:54.438731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:54.447694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce8506b8-aef6-4015-ab5d-17baaef22b71 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.172143 May 16 16:59:54.448464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 243/476] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:54 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:54.806428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:54.806952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:54.812966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:54.813626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:54.814420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:54.814854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:54.954161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:54.962622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-966f791d-f561-4ada-ae94-cf3a036dc3c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1512 microversion: 2.1 time: 0.160089 May 16 16:59:54.963203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 234/477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:54 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:55.345733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:55.346334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:55.352869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:55.353395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:55.354358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:55.354767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:55.464741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:55.466255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:55.477124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:55.479033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:55.480051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:55.482350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:55.504702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:55.513781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:55.515286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:55.516467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9b8b5e54-71b7-44d6-bca7-e74d5f778ff4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.174568 May 16 16:59:55.528088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 244/478] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:55.650058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:55.658244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0ab4ffa8-fcdc-42da-80e8-2731ec61377e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1508 microversion: 2.1 time: 0.197511 May 16 16:59:55.659238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 235/479] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:55 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 16:59:55.981666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:55.982313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:55.988207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:55.989217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:55.990008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:55.990446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:56.136096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:56.145490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9ab2e2b8-2f4d-4b82-ba39-cd8462d633ab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1512 microversion: 2.1 time: 0.167584 May 16 16:59:56.155123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 245/480] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:55 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:56.535492 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:56.536673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:56.546219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:56.547079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:56.548991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:56.549902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:56.675335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:56.675943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:56.683317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:56.684204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:56.685223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:56.685918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:56.903442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:56.921291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:56.923123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:56.924491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-31dc8db0-ae2a-4d9b-a0f9-3df17dbf38b6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.392951 May 16 16:59:56.925299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 236/481] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:56.948620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:56.958930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f236d6ca-b2a8-47fe-ba17-f2471ab0d810 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1514 microversion: 2.1 time: 0.287455 May 16 16:59:56.971798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 246/482] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:56 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:57.171308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:57.172049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:57.183691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:57.184145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:57.184930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:57.185361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:57.460895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:57.475345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-135c9f76-44b4-4eab-b0f0-cd626f7ae5f2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1512 microversion: 2.1 time: 0.315801 May 16 16:59:57.477037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 237/483] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:57 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:57.556245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-97b6db90-20ce-47f9-a5c5-e87e8e68785b req-0f1e3fb4-6928-4767-af53-af9f47f33112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d63564-f586-464a-9794-cd3ab451b3aa", "name": "network-vif-deleted", "tag": "aefc72a5-6bd1-4050-bc04-d86487257c17"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:57.565305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-97b6db90-20ce-47f9-a5c5-e87e8e68785b req-0f1e3fb4-6928-4767-af53-af9f47f33112 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:57.566096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-97b6db90-20ce-47f9-a5c5-e87e8e68785b req-0f1e3fb4-6928-4767-af53-af9f47f33112 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:57.582826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-97b6db90-20ce-47f9-a5c5-e87e8e68785b req-0f1e3fb4-6928-4767-af53-af9f47f33112 service nova] Creating event network-vif-deleted:aefc72a5-6bd1-4050-bc04-d86487257c17 for instance 81d63564-f586-464a-9794-cd3ab451b3aa on hv-cinder-83998 May 16 16:59:57.589277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-97b6db90-20ce-47f9-a5c5-e87e8e68785b req-0f1e3fb4-6928-4767-af53-af9f47f33112 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 May 16 16:59:57.593636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 247/484] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 16:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:57.943509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:57.944117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:57.951521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:57.952391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:57.953468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:57.954321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:58.115274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:58.123967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:58.126091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:58.127540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-54164ef1-2525-468b-99df-d1251adc86ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.188044 May 16 16:59:58.128104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 238/485] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:58.398904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-30732ee9-76e1-431a-8c73-b585a3daf9ec tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'create', calling method: .version_select at 0x7feacda0c3a0>, body: {"keypair": {"name": "tempest-keypair-1767529417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlhr8qI2iqAN/n7mO4T+nezUcbdO7q2ku1JknEC82h1fDbJCBhOe8Ktd0bEnMT57LCI/WelLX87fda2Z9r4j5GVF2wQjrwfOAEaNjOHWOb8mH6cW5qoxexnhIGMK75New=="}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 16:59:58.420205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-30732ee9-76e1-431a-8c73-b585a3daf9ec tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for project d288b61a6379415c9f773fc61950f570. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 16:59:58.424455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-30732ee9-76e1-431a-8c73-b585a3daf9ec tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for user 673ff42fb9454adf93be94f46e60755a and project d288b61a6379415c9f773fc61950f570. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 16:59:58.438080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30732ee9-76e1-431a-8c73-b585a3daf9ec tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [428b4b3f-8c3f-45bc-9fcb-65357bebee3d] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 16:59:58.494489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:58.495398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:58.503389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:58.505291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:58.506288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:58.507089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:58.545686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:58.546505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:58.547120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'fault' on Instance uuid 81d63564-f586-464a-9794-cd3ab451b3aa {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 16:59:58.597197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:58.607288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0f2c46fb-0272-4fb5-bcb8-da8334bd6542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 200 len: 1308 microversion: 2.1 time: 0.118636 May 16 16:59:58.622111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 239/486] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:58 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 16:59:59.147115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:59.149995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:59.159777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:59.165681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:59.166972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:59.167572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:59.369018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:59.378958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:59.380666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 16:59:59.382028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-049dcb9a-dd24-4492-8d9f-e7726b3d1a76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.239435 May 16 16:59:59.390592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 240/487] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 16:59:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 16:59:59.450350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [None req-30732ee9-76e1-431a-8c73-b585a3daf9ec tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [428b4b3f-8c3f-45bc-9fcb-65357bebee3d] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 38600. May 16 16:59:59.493782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-30732ee9-76e1-431a-8c73-b585a3daf9ec tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.099720 May 16 16:59:59.517943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 248/488] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 16:59:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 16:59:59.645083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 16:59:59.645849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 81d63564-f586-464a-9794-cd3ab451b3aa] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 16:59:59.656122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:59.662368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:59.663472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 16:59:59.664057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 16:59:59.693272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] HTTP exception thrown: Instance 81d63564-f586-464a-9794-cd3ab451b3aa could not be found. May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Request method failure captured: May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa HTTP/1.1 May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoLEX0V3p-2_bGNdQv5uW6avMJDBGpBvNKnAWV3tcqSSgh_cr9EWrcg5uUMy1yyKL6EMa1TS4dEcPXMLsl0ZRLHN6P5H7bZ4qVzLIB9_rVFykzoWXE-IjNT-BcgPctnTOPRbyapbT_W6W4ZGQL5Fmt1QfbzUPwaTBqNe-bR7q8b3RS8 May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: e07bcaeeb617491689c13594914b370e May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 16:59:59.697713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e07bcaeeb617491689c13594914b370e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e07bcaeeb617491689c13594914b370e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesSnapshotTestJSON-1770920123 May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: e07bcaeeb617491689c13594914b370e May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 3ab541e9017c4ece9432f1fedde0f64e May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 81d63564-f586-464a-9794-cd3ab451b3aa could not be found. May 16 16:59:59.699196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '81d63564-f586-464a-9794-cd3ab451b3aa'} May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d63564-f586-464a-9794-cd3ab451b3aa could not be found. May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 16:59:59.700011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d63564-f586-464a-9794-cd3ab451b3aa could not be found. May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d63564-f586-464a-9794-cd3ab451b3aa could not be found. May 16 16:59:59.701451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 16:59:59.713384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Returning 404 to user: Instance 81d63564-f586-464a-9794-cd3ab451b3aa could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 16:59:59.714559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1378f763-55c6-4b10-9d71-44339fe93f8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa" status: 404 len: 111 microversion: 2.1 time: 0.074052 May 16 16:59:59.715671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 241/489] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 16:59:59 2022] GET /compute/v2.1/servers/81d63564-f586-464a-9794-cd3ab451b3aa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:00:00.402229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:00.404001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:00.431540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:00.432332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:00.436565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:00.437359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:00.789489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:00.806357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:00.810737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:00.817108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a1d73403-58be-40b9-8cd7-75dad460f200 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.419458 May 16 17:00:00.819123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 249/490] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:01.837353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:01.839264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:01.857473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:01.858393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:01.860677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:01.862053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:01.873377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-318466450", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e644bf2-f482-4573-8a81-7be8b637b410"}], "security_groups": [{"name": "tempest-securitygroup--1760375920"}], "key_name": "tempest-keypair-1767529417", "user_data": "}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:02.094143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:02.112456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:02.122146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:02.124169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5e94d7c7-ae36-4102-ab42-1c44f86ef3e3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.291846 May 16 17:00:02.125279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 242/491] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:02.130307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:02.131569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:02.142572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.143911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.144922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.145870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.204921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f388bd80-8a2d-42a3-8f33-f58bf9e4c37f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/ips" status: 200 len: 150 microversion: 2.1 time: 0.078168 May 16 17:00:02.205523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 243/492] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:00:02 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/ips => generated 150 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:02.216861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a2a1ae1-fb34-495d-b16b-55202813542d"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:02.218451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:02.226393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.227163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.228251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.228916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.330409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Invalid volume: volume 4a2a1ae1-fb34-495d-b16b-55202813542d is already attached to instances: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: POST /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/os-volume_attachments HTTP/1.1 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 74 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:00:02.338345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {"volumeAttachment": {"volumeId": "4a2a1ae1-fb34-495d-b16b-55202813542d"}} May 16 17:00:02.340026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Invalid volume: volume 4a2a1ae1-fb34-495d-b16b-55202813542d is already attached to instances: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'server_id': '33c9ac7f-ecb0-453c-91c2-191f32b2958d', 'body': {'volumeAttachment': {'volumeId': '4a2a1ae1-fb34-495d-b16b-55202813542d'}}} May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4a2a1ae1-fb34-495d-b16b-55202813542d is already attached to instances: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:02.340966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4a2a1ae1-fb34-495d-b16b-55202813542d is already attached to instances: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:02.342427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4a2a1ae1-fb34-495d-b16b-55202813542d is already attached to instances: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 400 to user: Invalid volume: volume 4a2a1ae1-fb34-495d-b16b-55202813542d is already attached to instances: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-48caf56b-0985-40ff-b126-9b353b129cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127581 May 16 17:00:02.344448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 244/493] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 17:00:02 2022] POST /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 17:00:02.350413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:02.350941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:02.367102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.368147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.369361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.369821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.405041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:00:02.508632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1782f49f-5227-4e50-b499-0ffb3e0c9933 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 204 len: 0 microversion: 2.1 time: 0.162167 May 16 17:00:02.513276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 245/494] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:00:02 2022] DELETE /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 17:00:02.531321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:02.532378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:02.543467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.552335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.553945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:02.554618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:02.788235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:02.808061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f865a4ff-e99d-4fc0-ab56-732b10231655 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.285963 May 16 17:00:02.814104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 246/495] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:02 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:03.145156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:03.147343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:03.154849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:03.156225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:03.157249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:03.157933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:03.331226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:03.339863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:03.341374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:03.342570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76148c2f-b500-4a3c-ba7a-ac3a168aac9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.202947 May 16 17:00:03.343454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 247/496] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:00:03.828119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:03.828965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:03.836214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:03.836663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:03.837435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:03.837928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:03.984149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:03.996431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-02928609-d6b6-494e-909d-02ce697e9100 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.173258 May 16 17:00:04.006006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 248/497] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:03 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:04.020981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] validate_networks() for [('9e644bf2-f482-4573-8a81-7be8b637b410', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:00:04.362954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:04.364440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:04.371603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:04.372129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:04.372981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:04.373491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:04.431844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:00:04.432461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:00:04.433099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:00:04.433854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:00:04.434546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:00:04.444561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:04.445404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:04.446538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:04.447248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:04.466658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for project d288b61a6379415c9f773fc61950f570. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:00:04.474936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Getting quotas for user 673ff42fb9454adf93be94f46e60755a and project d288b61a6379415c9f773fc61950f570. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:00:04.486900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:00:04.490132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:00:04.515710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:04.525019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:04.526793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:04.528095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-97aae5a5-ea44-4d91-b5df-477f2cbcf782 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.169809 May 16 17:00:04.528917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 249/498] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:04.541296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-00fb5aa0-75a3-4ef2-abf5-10227e692e82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.674572 May 16 17:00:04.545813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 250/499] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:00:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:00:04.554029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5641b068-2d96-4a2a-a3fc-00208c9e92c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:04.554705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5641b068-2d96-4a2a-a3fc-00208c9e92c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:04.612503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5641b068-2d96-4a2a-a3fc-00208c9e92c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:04.620877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5641b068-2d96-4a2a-a3fc-00208c9e92c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1245 microversion: 2.1 time: 0.071275 May 16 17:00:04.621690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 250/500] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:04 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:05.020030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:05.020661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:05.029127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:05.029867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:05.030500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:05.031005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:05.172424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:05.180167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-19252c0d-1f43-4985-afa9-4ec7b9129666 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.165018 May 16 17:00:05.180843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 251/501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:05 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:05.548278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:05.548991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:05.555954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:05.556401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:05.557164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:05.557598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:05.640265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:05.640938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:05.657634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:05.658446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:05.659781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:05.660613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:05.708956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:05.722079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:05.723881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:05.725057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d9624aab-7fcd-4467-a3e1-d7eae024fd6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.180751 May 16 17:00:05.726115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 251/502] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:05.759040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:05.766633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-759521b4-6ba2-4b7e-bd52-83d8d2f1057c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1249 microversion: 2.1 time: 0.132566 May 16 17:00:05.767285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 252/503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:05 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1249 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:06.216160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:06.216772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:06.238395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:06.239147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:06.240135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:06.240760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:06.411556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:06.418207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c2ba892e-8e2c-48bd-adc3-806d73456a6e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.215054 May 16 17:00:06.418921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 252/504] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:06 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:06.748343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:06.748951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:06.761004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:06.761457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:06.762396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:06.762994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:06.785606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:06.786852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:06.794071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:06.794569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:06.795424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:06.795932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:06.870782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:06.880558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-871e5921-c1fb-4ad0-8694-63d1d3d31ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1249 microversion: 2.1 time: 0.100556 May 16 17:00:06.881855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 253/505] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:06 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:06.933325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:06.942911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:06.944533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:06.945813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b033dec-e6cc-4fb8-93b3-3dbef4565613 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.204964 May 16 17:00:06.946770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 253/506] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:00:07.435583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:07.436198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:07.442359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:07.442817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:07.443605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:07.444048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:07.586453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:07.594798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-642912fb-398c-40e6-b951-50b748e7318a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.163022 May 16 17:00:07.595601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 254/507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:07 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:07.897976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:07.898588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:07.904914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:07.905398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:07.906189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:07.906629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:07.970146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:07.979055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:07.980327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:07.981190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9fcdde77-fbd4-41b2-a10f-d62531d00c21 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1249 microversion: 2.1 time: 0.087435 May 16 17:00:07.981820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 254/508] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:07 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:07.995916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:07.996659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:07.997608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:07.998077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:08.136218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:08.144858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:08.146537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:08.147814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-88469da7-19d1-4042-ab60-d510ab61568f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.187442 May 16 17:00:08.148474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 255/509] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:00:08.612560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:08.613676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:08.619538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:08.619981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:08.620734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:08.621160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:08.743427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:08.750593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-11b11fe7-6fe7-4c2c-b9a9-9542ec0230f9 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.141840 May 16 17:00:08.751303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 255/510] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:08 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:08.997076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:08.997601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:09.003987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:09.004445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:09.005250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:09.005690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:09.070076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:09.077361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c59747b8-09cf-48de-a2e0-631daac94ce1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1249 microversion: 2.1 time: 0.084214 May 16 17:00:09.077948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 256/511] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:08 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:09.167030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:09.167642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:09.173865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:09.174315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:09.175109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:09.175542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:09.304920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:09.312931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:09.314447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:09.315588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f2d78417-fdb8-4ab7-8c45-d6a0621f4b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.152435 May 16 17:00:09.316160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 256/512] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:09.770162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:09.770821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:09.776937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:09.777392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:09.778203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:09.778670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:09.906703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:09.915084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f2350d9b-95a6-463e-9a8a-3543ec0e7f79 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.151133 May 16 17:00:09.915652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 257/513] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:09 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:10.093966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:10.094577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:10.100656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:10.101105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:10.101900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:10.102337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:10.160437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:10.167648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-15911ce7-1ed7-45bc-a4d8-c700af4678de tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1249 microversion: 2.1 time: 0.077619 May 16 17:00:10.168275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 257/514] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:10 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:10.333318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:10.333966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:10.340222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:10.340674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:10.341449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:10.341926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:10.473502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:10.481635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:10.483149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:10.484303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e954a45d-e733-4e57-bee1-29fb4c7b7f4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.154916 May 16 17:00:10.484861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 258/515] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:10.898448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1514971195", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "networks": [{"uuid": "dfa64bed-e486-4f5e-8309-9f21280f6cd5"}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:10.935591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:10.936213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:10.942471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:10.943069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:10.943852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:10.944295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:10.951818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] validate_networks() for [('dfa64bed-e486-4f5e-8309-9f21280f6cd5', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:00:11.074350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:11.082663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dd5a452d-f229-4612-bc41-b2a387135e52 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.153516 May 16 17:00:11.083320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 259/516] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:10 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:11.184746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:11.185353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:11.191768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:11.192218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:11.193397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:11.193593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:11.256187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:11.265245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c7b557f8-4769-434b-a749-4b4b6479e372 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1249 microversion: 2.1 time: 0.084457 May 16 17:00:11.266174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 260/517] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:11 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:11.420510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:00:11.420995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:00:11.421399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:00:11.421856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:00:11.422293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:00:11.431325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:11.431776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:11.432579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:11.433017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:11.449622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Getting quotas for project e07bcaeeb617491689c13594914b370e. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:00:11.453316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Getting quotas for user 3ab541e9017c4ece9432f1fedde0f64e and project e07bcaeeb617491689c13594914b370e. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:00:11.464035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:00:11.466193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:00:11.502880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:11.504298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:11.510467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:11.511534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:11.512313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:11.512765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bd9aa96d-955b-4861-87db-3036dc46b48f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618562 May 16 17:00:11.513107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:11.517942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 258/518] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:00:11.523210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b835116d-f42b-4363-afb0-9b2763c103b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:11.524158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b835116d-f42b-4363-afb0-9b2763c103b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:11.580233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b835116d-f42b-4363-afb0-9b2763c103b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:11.586847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b835116d-f42b-4363-afb0-9b2763c103b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1219 microversion: 2.1 time: 0.067309 May 16 17:00:11.597094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 259/519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:11.678036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:11.687280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:11.689212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:11.690701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-81b9c9cf-5325-4777-873d-42083ae795fe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.191711 May 16 17:00:11.692111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 261/520] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:00:12.100513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:12.101207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:12.108423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.109060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.110245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.110745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.268678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:12.277347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e105fe4d-d1a9-428a-a4a0-63009465287e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.180483 May 16 17:00:12.277347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 260/521] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:12 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:12.282996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:12.283607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:12.289465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.289957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.290727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.291166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.389555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:12.399438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6b6d5dd1-1123-4feb-93a5-0d359d4b5502 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1297 microversion: 2.1 time: 0.120313 May 16 17:00:12.410727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 262/522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:12 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1297 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:12.604495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:12.605107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:12.610863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.611433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.612199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.612634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.673652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:12.681542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c85aabcc-d40d-4e5e-a0c8-1d6615f3bd6e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1271 microversion: 2.1 time: 0.080807 May 16 17:00:12.682148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 261/523] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:12 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:12.710787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:12.711384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:12.717750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.718223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.719028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:12.719465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:12.960142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:12.969073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:12.970889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:12.972046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d613cc25-5c7d-4a7a-b7c5-9c24df53e1d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.265182 May 16 17:00:12.983657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 263/524] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:13.293846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:13.294530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:13.302166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.302619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.303391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.303823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.416943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:13.417800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:13.423889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.424651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.426305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.426821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.453392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:13.460874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-594a3f69-8c99-4377-b500-8bb489a6a609 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1680 microversion: 2.1 time: 0.170953 May 16 17:00:13.461452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 262/525] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:13 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:13.512185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:13.520362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2af08529-2206-44d8-928a-5a187e0cc308 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1305 microversion: 2.1 time: 0.107038 May 16 17:00:13.521543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 264/526] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:13 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:13.698861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:13.699465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:13.706209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.707104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.708069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.708503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.772152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:13.779745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f2a9041a-9dd9-425a-8a05-d3eb8c79eab5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1271 microversion: 2.1 time: 0.084862 May 16 17:00:13.780601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 263/527] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:13.945277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-6b758fcd-b9fa-4d6e-a205-44b6a39fac8f req-8e11df4d-9391-4b0d-95e1-98dadeb2b54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c9ac7f-ecb0-453c-91c2-191f32b2958d", "name": "network-vif-deleted", "tag": "d27e0ff3-d6c6-4dd0-9992-12170feea445"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:13.958056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-6b758fcd-b9fa-4d6e-a205-44b6a39fac8f req-8e11df4d-9391-4b0d-95e1-98dadeb2b54a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:13.986524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-6b758fcd-b9fa-4d6e-a205-44b6a39fac8f req-8e11df4d-9391-4b0d-95e1-98dadeb2b54a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:13.992583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:13.995048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:14.010874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.011883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.015095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.015734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.016064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-6b758fcd-b9fa-4d6e-a205-44b6a39fac8f req-8e11df4d-9391-4b0d-95e1-98dadeb2b54a service nova] Creating event network-vif-deleted:d27e0ff3-d6c6-4dd0-9992-12170feea445 for instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d on hv-cinder-83998 May 16 17:00:14.040596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-6b758fcd-b9fa-4d6e-a205-44b6a39fac8f req-8e11df4d-9391-4b0d-95e1-98dadeb2b54a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100104 May 16 17:00:14.046503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 265/528] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:14.187578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1437975866", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:14.288574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] validate_networks() for None {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:00:14.376855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:14.390156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:14.392249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:14.393873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17db1b3a-05f9-477a-ab92-5dd406118cfb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.407208 May 16 17:00:14.395569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 264/529] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:00:14.479095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:14.479939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:14.495103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.495804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.497013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.497631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.532086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.532295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.532737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lazy-loading 'fault' on Instance uuid 33c9ac7f-ecb0-453c-91c2-191f32b2958d {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:00:14.578995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:14.587329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7f398b55-e3cb-4277-92d9-e406da7fc0f8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 200 len: 1330 microversion: 2.1 time: 0.112789 May 16 17:00:14.598264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 265/530] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:14 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:14.603448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:14.604293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:14.610793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.611554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.612666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.613863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.754159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:14.766206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-01a1b762-2cfe-4013-a220-5ac46a7e54c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1303 microversion: 2.1 time: 0.166465 May 16 17:00:14.766803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 266/531] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:14 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:14.797707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:14.798362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:14.807090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.807929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.809000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.809766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.862042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:00:14.862493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:00:14.863585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:00:14.864057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:00:14.864478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:00:14.880293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.881608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.884230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:14.884872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:14.923716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Getting quotas for project 513196f833e447a989898b7daee36ba3. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:00:14.942231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Getting quotas for user 39b7ce7aa84c42c0a14351feb37b4d9d and project 513196f833e447a989898b7daee36ba3. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:00:14.960658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:14.969707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:00:14.971896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-85c3ffdb-ebd1-44e5-a58d-0f8218981fe8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1277 microversion: 2.1 time: 0.178147 May 16 17:00:14.973988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:00:14.977815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 267/532] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:14 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:15.052121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aea10e5f-e3b0-45d5-8db1-3091af9e11ae tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866298 May 16 17:00:15.053589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 266/533] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:00:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:00:15.069275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e3cafebe-7b0f-4854-84cd-ac961d604e15 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:15.072877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e3cafebe-7b0f-4854-84cd-ac961d604e15 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:15.171005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e3cafebe-7b0f-4854-84cd-ac961d604e15 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:15.178645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e3cafebe-7b0f-4854-84cd-ac961d604e15 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1215 microversion: 2.1 time: 0.117875 May 16 17:00:15.199270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 268/534] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:15 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:15.413977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:15.415261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:15.446386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:15.450086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:15.451790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:15.454294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:15.618419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:15.622082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:15.631548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:15.632376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:15.633846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:15.634525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:15.671628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d HTTP/1.1 May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:00:15.676596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:00:15.678500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '33c9ac7f-ecb0-453c-91c2-191f32b2958d'} May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:00:15.679376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:00:15.680806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:15.682481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:00:15.682481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-775cf5ca-e768-4503-988d-944c8a773c20 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 404 len: 111 microversion: 2.1 time: 0.076738 May 16 17:00:15.682481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 269/535] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:15 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:00:15.694742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-89119340-634e-4b13-a2af-fe7bde85e262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '.version_select at 0x7feacd94f940>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:15.734511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-89119340-634e-4b13-a2af-fe7bde85e262 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-477017817" status: 202 len: 0 microversion: 2.1 time: 0.047912 May 16 17:00:15.737044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 270/536] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 16 17:00:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-477017817 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:00:15.764235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:15.775860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:15.779978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:15.781520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9dedd626-5b26-4367-8959-ea774b8be3f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.372377 May 16 17:00:15.784255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 267/537] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:15.790537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:15.791189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:15.818088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:15.819373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:15.824728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:15.826705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:15.994250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:15.995014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:16.015119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:16.015754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:16.016748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:16.017295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:16.397761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:16.418855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-884a9593-2264-4286-8c25-976dbeb8aaf1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.428712 May 16 17:00:16.420004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 268/538] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:15 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:16.426273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:16.427215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:16.434421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:16.435729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:16.436864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:16.437471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:16.533641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:16.545851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:16.548171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-877f9bb1-fbb9-4224-9986-43cc495485fd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.766752 May 16 17:00:16.548763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 271/539] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:15 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:16.571311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-db4ff028-fd70-41d1-b2c1-0af80e13d0bc tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1267 microversion: 2.1 time: 0.146324 May 16 17:00:16.572000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 269/540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:16 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:16.802951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:16.804350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:16.817296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:16.817805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:16.818639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:16.823276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.236841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-6285a7b7-0411-48c2-8725-4faa352af89a req-a0fd1fc4-9224-4f26-91f3-229172feccf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38da705b-728f-449a-99ef-1428962695d3", "tag": "be876588-aea6-45b4-9f5d-c0b6fe68b534"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:17.288585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-6285a7b7-0411-48c2-8725-4faa352af89a req-a0fd1fc4-9224-4f26-91f3-229172feccf8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.289499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-6285a7b7-0411-48c2-8725-4faa352af89a req-a0fd1fc4-9224-4f26-91f3-229172feccf8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.305100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-6285a7b7-0411-48c2-8725-4faa352af89a req-a0fd1fc4-9224-4f26-91f3-229172feccf8 service nova] Creating event network-changed:be876588-aea6-45b4-9f5d-c0b6fe68b534 for instance 38da705b-728f-449a-99ef-1428962695d3 on hv-cinder-83998 May 16 17:00:17.305535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:17.319049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:17.321145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:17.324667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a8ac7e6c-73de-4a99-bb24-f88300316a41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.526914 May 16 17:00:17.327973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-6285a7b7-0411-48c2-8725-4faa352af89a req-a0fd1fc4-9224-4f26-91f3-229172feccf8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099564 May 16 17:00:17.329403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 270/541] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:17.330682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 272/542] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:17.438918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:17.439773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:17.446731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.447314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.448369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.448910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.568284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:17.569208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:17.577333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.577672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.578630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.579019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.750908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:17.760685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ca5ab147-d430-42fa-8316-02491929399d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.327066 May 16 17:00:17.761782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 271/543] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:17 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:17.779059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:17.780142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:17.814265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.816301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.819648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.821970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.912163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:17.927076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-95d775b7-f633-41e0-9d08-baf5d3ebc6fe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.364974 May 16 17:00:17.937242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 273/544] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:17 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:17.942526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-046f294b-319f-4c67-9fb6-ee9fcde3bb26 req-2fe8bdaf-8508-430e-b5c4-909b87880d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384369a3-d514-4873-94eb-c7f9ffc45283", "tag": "72814607-d40d-405f-923f-0e3b33277529"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:17.951104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-046f294b-319f-4c67-9fb6-ee9fcde3bb26 req-2fe8bdaf-8508-430e-b5c4-909b87880d6c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:17.951840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-046f294b-319f-4c67-9fb6-ee9fcde3bb26 req-2fe8bdaf-8508-430e-b5c4-909b87880d6c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:17.965074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-046f294b-319f-4c67-9fb6-ee9fcde3bb26 req-2fe8bdaf-8508-430e-b5c4-909b87880d6c service nova] Creating event network-changed:72814607-d40d-405f-923f-0e3b33277529 for instance 384369a3-d514-4873-94eb-c7f9ffc45283 on hv-cinder-83998 May 16 17:00:17.981958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-046f294b-319f-4c67-9fb6-ee9fcde3bb26 req-2fe8bdaf-8508-430e-b5c4-909b87880d6c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 May 16 17:00:17.983335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 274/545] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:17.985917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:18.000232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:18.001034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:18.001181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f28226d-ba45-4298-8d86-bce20651e888 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1273 microversion: 2.1 time: 0.224929 May 16 17:00:18.001824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 272/546] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:17 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:18.009090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.009985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.010910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.011490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.075831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-10b8f5ba-22c1-431f-8038-8a34f3b279e2 req-edbf5293-192c-4744-af3f-95fe90ad0c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "name": "network-vif-plugged", "status": "completed", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:18.087546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-10b8f5ba-22c1-431f-8038-8a34f3b279e2 req-edbf5293-192c-4744-af3f-95fe90ad0c1c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.088132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-10b8f5ba-22c1-431f-8038-8a34f3b279e2 req-edbf5293-192c-4744-af3f-95fe90ad0c1c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.108667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-10b8f5ba-22c1-431f-8038-8a34f3b279e2 req-edbf5293-192c-4744-af3f-95fe90ad0c1c service nova] Creating event network-vif-plugged:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 17:00:18.114503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-10b8f5ba-22c1-431f-8038-8a34f3b279e2 req-edbf5293-192c-4744-af3f-95fe90ad0c1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052546 May 16 17:00:18.115558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 273/547] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:00:18.119735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lazy-loading 'services' on Instance uuid e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:00:18.202512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab4c922b-bbfb-4a4d-a0c0-5632486b2b19 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments/4a2a1ae1-fb34-495d-b16b-55202813542d" status: 202 len: 0 microversion: 2.1 time: 0.216856 May 16 17:00:18.203368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 275/548] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:00:17 2022] DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments/4a2a1ae1-fb34-495d-b16b-55202813542d => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:00:18.212773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:18.213810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:18.219761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.220213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.220969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.221404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.252115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1539eebb-8d05-4332-897f-b5026e5f708d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 May 16 17:00:18.253104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 274/549] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:00:18 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:18.349895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:18.350600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:18.356607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.357056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.357845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.358282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.551846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:18.560535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:18.562052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:18.563229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-189ab554-795c-4845-a076-6b4488aaf064 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.218552 May 16 17:00:18.563816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 276/550] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:18.780098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:18.780642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:18.787444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.787889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.788643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.789074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.912967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:18.920114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4a211327-7064-4751-8ffc-5364de8778aa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.144028 May 16 17:00:18.920672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 275/551] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:18.943777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:18.944390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:18.950628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.951074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:18.951834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:18.952265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.018246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:19.019377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:19.025069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.025512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.026301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.026730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.079361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:19.086719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d1420f0d-fd87-4e11-a134-ba5d16daad3c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.146736 May 16 17:00:19.087309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 277/552] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:18 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:19.154883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:19.162175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eca232e8-d717-46ff-b402-6728695a2b6c tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.147743 May 16 17:00:19.162753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 276/553] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:19 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:19.263745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:19.264736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:19.271083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.271528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.272279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.272711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.301587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-64ea0824-199e-472a-8a05-951d209a3a23 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 May 16 17:00:19.302156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 278/554] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:00:19 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:19.580365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:19.582305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:19.589621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.590586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.591466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.592050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.724415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:19.734883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:19.736389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:19.737567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7c89904c-b880-4bd1-be46-5c9a2acd9277 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.161089 May 16 17:00:19.738411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 277/555] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:19.936108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:19.936772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:19.943778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.944434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:19.945319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:19.945994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.103578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:20.104293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:20.110840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.111374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.112227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.112741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.256593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:20.259927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:20.265894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1a7588ad-1fc6-4db9-9261-c83690770e67 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.166028 May 16 17:00:20.267013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 278/556] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:20 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:20.268225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-94aa3fb2-3669-4c0a-bac4-4a6594759dad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.336035 May 16 17:00:20.268799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 279/557] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:19 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:20.273275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:20.274123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:20.282298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.282749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.283537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.283976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.312492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:20.313420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:20.321063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.321514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.322336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.322767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.352820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ca7e2828-dcbb-46fc-8273-f7e2b2684442 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 May 16 17:00:20.353479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 280/558] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:00:20 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:00:20.414072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-66dd9502-e433-44f7-8fac-2bc09a91bf95 req-57c8fbfc-e4a5-4fe9-b5eb-9cffb93a3da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743bb75d-843c-4cb3-afc5-2d41d95014ec", "tag": "2a7d1d6a-6fa8-4026-8d6f-1b9ba05cd9e1"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:20.427564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:20.432294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-66dd9502-e433-44f7-8fac-2bc09a91bf95 req-57c8fbfc-e4a5-4fe9-b5eb-9cffb93a3da3 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.432967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-66dd9502-e433-44f7-8fac-2bc09a91bf95 req-57c8fbfc-e4a5-4fe9-b5eb-9cffb93a3da3 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.444531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-99b33871-594f-42af-8922-042fe4bb8288 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.174921 May 16 17:00:20.445726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 279/559] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:20 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:20.451926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-66dd9502-e433-44f7-8fac-2bc09a91bf95 req-57c8fbfc-e4a5-4fe9-b5eb-9cffb93a3da3 service nova] Creating event network-changed:2a7d1d6a-6fa8-4026-8d6f-1b9ba05cd9e1 for instance 743bb75d-843c-4cb3-afc5-2d41d95014ec on hv-cinder-83998 May 16 17:00:20.458447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-66dd9502-e433-44f7-8fac-2bc09a91bf95 req-57c8fbfc-e4a5-4fe9-b5eb-9cffb93a3da3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048115 May 16 17:00:20.462677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 281/560] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:20.756443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:20.756979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:20.763195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.763645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.764426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:20.764859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:20.896528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:20.905044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:20.906607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:20.907751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-61bff0eb-9169-43de-aefe-62bdcc59f02f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.156002 May 16 17:00:20.908315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 280/561] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:21.285691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:21.286417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:21.291599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:21.292211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:21.292734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.293183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.294005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.294440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.298418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.298865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.299627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.300081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.422659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:21.427518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:21.430060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4f988158-cb35-4d3c-ad84-5a52ad7e793d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.149618 May 16 17:00:21.436428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 282/562] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:21 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:21.436573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3fafbee3-a8fe-40a1-80a3-9890a5b6b6af tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.147043 May 16 17:00:21.436657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:21.436767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 281/563] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:21 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:21.436851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:21.441689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.442162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.442915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.443370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.462569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:21.463181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:21.468980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.469415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.470210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.470644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.471986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-979de010-c563-4681-8ca4-0cdb684244ee tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040341 May 16 17:00:21.473477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 283/564] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:00:21 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:21.597313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:21.604711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f91fd8f3-fae9-4b46-aac2-43f5132e61e3 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.145848 May 16 17:00:21.605299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 282/565] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:21 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:21.927054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:21.927674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:21.933384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.933875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:21.934657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:21.935096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.267686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:22.276351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:22.277887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:22.279182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-927645f9-57f4-4f16-a7e6-897dc8dbb5d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.356502 May 16 17:00:22.279747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 284/566] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:22.445960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:22.446569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:22.450977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:22.451588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:22.452905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.453349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.454135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.454565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.458065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.458521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.459287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.459722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.638381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:22.651796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-137bab77-684f-48ce-b633-f056ce9c67ca tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.204466 May 16 17:00:22.652892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 285/567] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:22 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:22.658847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:22.660790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:22.663588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:22.670166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.670614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.671387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.671819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.672348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c06725ed-55f2-469e-ad46-1ba066fa10ed tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.230063 May 16 17:00:22.681630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 283/568] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:22 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:22.687379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:22.687996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:22.695077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.695530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.696312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.696749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.701638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e1efb9e8-71b1-43e0-986f-a09685b3f0e3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047539 May 16 17:00:22.702570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 286/569] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:00:22 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:00:22.759506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:22.759994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:22.765862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.766308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.767062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.767490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.792527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:00:22.834329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:22.841696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cc8d9c22-ae60-4eb3-a9fe-0352b75ec5a5 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.158654 May 16 17:00:22.842293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 284/570] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:22 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:22.868725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-782e7354-dc59-441b-a0d6-23ff94065cfc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 204 len: 0 microversion: 2.1 time: 0.112814 May 16 17:00:22.869307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 287/571] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:00:22 2022] DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 17:00:22.877411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:22.878065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:22.883913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.884419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:22.885197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:22.885640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.007716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:23.015000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-927b657b-5035-4f74-b81e-f3c120f288aa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1681 microversion: 2.1 time: 0.141422 May 16 17:00:23.015568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 285/572] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:22 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1681 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:23.298806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:23.299461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:23.305385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.305866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.306629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.307063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.451899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:23.460683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:23.462271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:23.463431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61284ef4-7619-4ff3-bb58-315b481d6e4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.168995 May 16 17:00:23.463990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 288/573] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:23.669456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:23.670101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:23.677203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.677657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.678455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.678889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.688150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:23.688762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:23.695119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.695570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.696362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.696793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.809255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:23.816597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-744f5610-505b-4f93-9b83-746a2e43dd06 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.151059 May 16 17:00:23.817173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 286/574] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:23.824906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:23.832138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-60d2b9fa-3de1-4ee4-ada8-043ace998046 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.147815 May 16 17:00:23.832708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 289/575] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:23 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:23.859307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:23.859920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:23.866419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.866872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.867968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:23.868063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:23.993963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:24.001094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4a3a182f-e41f-4b63-b9c4-35b95f2c4b55 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.145509 May 16 17:00:24.001669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 287/576] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:23 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:24.032433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:24.033047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:24.039332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.039774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.040526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.040950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.164491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-9bbc4f64-4568-4a13-90d9-cdf231d1a00c req-12ec3ca1-c1c3-4b24-b73b-d7408a3fd7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38da705b-728f-449a-99ef-1428962695d3", "name": "network-vif-plugged", "status": "completed", "tag": "be876588-aea6-45b4-9f5d-c0b6fe68b534"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:24.168885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:24.172994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-9bbc4f64-4568-4a13-90d9-cdf231d1a00c req-12ec3ca1-c1c3-4b24-b73b-d7408a3fd7b8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.173509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-9bbc4f64-4568-4a13-90d9-cdf231d1a00c req-12ec3ca1-c1c3-4b24-b73b-d7408a3fd7b8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.180069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-48c6d32e-fcad-47c1-9585-93f9dbadccd6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1681 microversion: 2.1 time: 0.151372 May 16 17:00:24.181791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 290/577] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:24 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:24.192295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-9bbc4f64-4568-4a13-90d9-cdf231d1a00c req-12ec3ca1-c1c3-4b24-b73b-d7408a3fd7b8 service nova] Creating event network-vif-plugged:be876588-aea6-45b4-9f5d-c0b6fe68b534 for instance 38da705b-728f-449a-99ef-1428962695d3 on hv-cinder-83998 May 16 17:00:24.197438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-9bbc4f64-4568-4a13-90d9-cdf231d1a00c req-12ec3ca1-c1c3-4b24-b73b-d7408a3fd7b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037387 May 16 17:00:24.198024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 288/578] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:24.481833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:24.482384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:24.489126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.489579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.490366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.490801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.834098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:24.834898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:24.841047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.841502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.843203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.843203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.846511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:24.855644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:24.857152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:24.858784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6e60e694-f1fc-439d-b6af-58d5867adbe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.380503 May 16 17:00:24.863820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 291/579] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:24.872160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:24.872777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:24.878749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.879207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.879980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:24.880732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:24.976823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:24.984137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-32eff7ef-9677-4c8f-a009-87353df82aff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.155181 May 16 17:00:24.984728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 289/580] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:24 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:25.007696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:25.014898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-00970307-c03c-450a-ad37-d22c2d31bf1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.148541 May 16 17:00:25.015467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 292/581] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:24 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:25.017923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:25.018583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:25.024925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:25.025311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:25.026093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:25.026523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:25.149117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:25.156375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-827e2e39-ce7c-4538-beb1-1a642566abb6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.142416 May 16 17:00:25.156943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 290/582] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:25 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:25.197110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:25.197717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:25.203556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:25.203998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:25.204755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:25.205191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:25.356986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:25.365139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7bd2dc86-6333-4a35-8bc2-e15e7a882467 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1681 microversion: 2.1 time: 0.171804 May 16 17:00:25.365880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 293/583] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:25 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:25.876333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:25.877603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:25.884474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:25.884950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:25.885730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:25.886195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.000639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:26.002019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:26.009497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.009972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.010965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.011432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.017135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.026674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.028935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.030446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5069f264-86cd-41e4-b666-0903d38f5e87 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1809 microversion: 2.20 time: 0.158047 May 16 17:00:26.041885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 291/584] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:26.047398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:26.048243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:26.054350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.055012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.055790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.056226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.225627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.234304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2920b0be-8b1d-4203-b877-5dbbb413be10 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.190984 May 16 17:00:26.235703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 292/585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:26 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:26.240445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:26.241448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:26.243639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.247928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.248389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.249174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.249615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.252774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e3e06744-642b-4164-9c9a-7ae971722cab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.255851 May 16 17:00:26.254040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 294/586] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:25 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:26.258720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-d6d49ce1-4668-4a8f-b1f5-0468f9bcf3c9 req-f739875e-17fa-4bcb-b501-17604cc9d1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384369a3-d514-4873-94eb-c7f9ffc45283", "name": "network-vif-plugged", "status": "completed", "tag": "72814607-d40d-405f-923f-0e3b33277529"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:26.266585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-d6d49ce1-4668-4a8f-b1f5-0468f9bcf3c9 req-f739875e-17fa-4bcb-b501-17604cc9d1cb service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.267026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-d6d49ce1-4668-4a8f-b1f5-0468f9bcf3c9 req-f739875e-17fa-4bcb-b501-17604cc9d1cb service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.278629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-d6d49ce1-4668-4a8f-b1f5-0468f9bcf3c9 req-f739875e-17fa-4bcb-b501-17604cc9d1cb service nova] Creating event network-vif-plugged:72814607-d40d-405f-923f-0e3b33277529 for instance 384369a3-d514-4873-94eb-c7f9ffc45283 on hv-cinder-83998 May 16 17:00:26.283652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-d6d49ce1-4668-4a8f-b1f5-0468f9bcf3c9 req-f739875e-17fa-4bcb-b501-17604cc9d1cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028417 May 16 17:00:26.284264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 295/587] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:26.381212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.383068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:26.383766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:26.388617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-40ad9e13-17f3-43a5-b469-ec4878451dff tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.151763 May 16 17:00:26.389191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 293/588] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:26 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:26.389900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.390363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.391136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:26.391577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:26.720146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:26.731909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a543e90f-dc21-4173-800d-dd958e3b38b1 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1681 microversion: 2.1 time: 0.353491 May 16 17:00:26.742322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 296/589] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:26 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:27.048392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:27.049020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:27.056033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.056481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.057255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.057686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.188504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.197076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.198657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.199832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a7cda56a-40ef-4526-8ef6-dbbf6a75e5af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1796 microversion: 2.20 time: 0.155417 May 16 17:00:27.200404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 294/590] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:00:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:00:27.252484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:27.253232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:27.260169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.260720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.261597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.262244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.270775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:27.271394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:27.279282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.279959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.280752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.281382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.417410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.425110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aaaa52fa-4031-46cb-81a6-90daaa57da11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.158882 May 16 17:00:27.425715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 295/591] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:27.430491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:27.431276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:27.436885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.437338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.438194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.438632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.447574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.455070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dc132c9c-a3d5-43a7-bdfa-7a43832a59d1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.207038 May 16 17:00:27.455767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 297/592] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:27 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:27.567821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.575259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-69f81c65-6eec-42b7-bbc5-4bce716c8a52 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.148575 May 16 17:00:27.590788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 296/593] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:27 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:27.598681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-2ab915e9-4a0b-4532-98b5-a569eee574a1 req-566e2192-19b8-4a66-8909-c532cbf64d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21efdaa-3bbe-4f8b-953d-6baaaadb9b53", "name": "network-vif-deleted", "tag": "21ca2048-d933-4aa6-b313-3a05ab94f9bb"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:27.608383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-2ab915e9-4a0b-4532-98b5-a569eee574a1 req-566e2192-19b8-4a66-8909-c532cbf64d1d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.609127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-2ab915e9-4a0b-4532-98b5-a569eee574a1 req-566e2192-19b8-4a66-8909-c532cbf64d1d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.623441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-2ab915e9-4a0b-4532-98b5-a569eee574a1 req-566e2192-19b8-4a66-8909-c532cbf64d1d service nova] Creating event network-vif-deleted:21ca2048-d933-4aa6-b313-3a05ab94f9bb for instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 on hv-cinder-83998 May 16 17:00:27.629037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-2ab915e9-4a0b-4532-98b5-a569eee574a1 req-566e2192-19b8-4a66-8909-c532cbf64d1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 May 16 17:00:27.629859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 298/594] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:27.749825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:27.750441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:27.757365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.758136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.758609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:27.759041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:27.820050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:27.827367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-430f72a1-1275-4156-a701-ca64ac92fa61 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1614 microversion: 2.1 time: 0.081397 May 16 17:00:27.827930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 297/595] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:27 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:28.444162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:28.444915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:28.451056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.451576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.452415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.452859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.471493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:28.472906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:28.479225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.479680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.480463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.480900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.593886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:28.601991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6dcf54fd-1025-4bfb-9879-d94fa0cfd74a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.162817 May 16 17:00:28.602566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 299/596] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:28.606932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:28.607856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:28.613845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.614358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.615117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.615650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.618413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:28.625796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a78b3245-564b-4583-bec8-c3ee222d65d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.158076 May 16 17:00:28.626468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 298/597] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:28 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:28.745647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:28.752837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-22774332-417e-4e15-895b-ddda5a76f222 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.149346 May 16 17:00:28.753433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 300/598] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:28 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:28.844278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:28.845042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:28.852191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.852641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.853405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:28.853866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:28.922494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:28.929953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bea544d5-9c82-4b9f-8eea-0c7d90b768f3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1614 microversion: 2.1 time: 0.089470 May 16 17:00:28.930523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 299/599] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:28 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:29.618624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:29.619217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:29.625547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.626014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.626776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.627207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.643829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:29.645174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:29.652104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.652560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.653360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.653825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.758328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:29.765603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4500a0bf-04c7-41fb-8914-8846e671d570 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1319 microversion: 2.1 time: 0.150800 May 16 17:00:29.766213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 301/600] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:29 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:29.771279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:29.772042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:29.777796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.778254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.779020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.779455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.781828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:29.789971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a038f0bd-7112-4fdf-968f-b3e03d9b0347 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1371 microversion: 2.1 time: 0.151129 May 16 17:00:29.790881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 300/601] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:29 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:29.908413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:29.915808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d280c56f-7c4b-4099-ad9f-b57d37047ee7 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.148623 May 16 17:00:29.916390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 302/602] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:29 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:29.946431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:29.947047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:29.953051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.953894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:29.954633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:29.955066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.022507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:30.029767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d4095391-d1dc-4d18-bc49-4d397c18c61d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1326 microversion: 2.1 time: 0.087191 May 16 17:00:30.030337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 301/603] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:29 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:30.782725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:30.783250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:30.790067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.790507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.791293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.791723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.807329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:30.807936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:30.814095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.814543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.815308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.815743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.922021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:30.929440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-31cde947-ada5-4816-af77-433d1ecf810a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1507 microversion: 2.1 time: 0.150568 May 16 17:00:30.930074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 303/604] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:30.936224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:30.936832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:30.943129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.943576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.944338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.944762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.952489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:30.960534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-092b7cf2-d3d3-4420-9f0a-6d768c910bd0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1565 microversion: 2.1 time: 0.157035 May 16 17:00:30.961180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 302/605] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:30 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:30.965855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caece44f-fa74-47ca-b9b2-3328236ee4dc", "device": "/dev/sdb"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:30.967067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:30.974098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.974625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:30.975456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:30.975893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.073086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:31.080295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-99ed9a62-4f67-4207-875b-08cbf9477fc6 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.149291 May 16 17:00:31.080860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 304/606] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:30 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:31.085882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:31.086372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:31.091724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.092178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.092949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.093388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.167515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0cc309f7-0a42-4bc0-be25-c47466b746ad tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.085601 May 16 17:00:31.168147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 305/607] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 17:00:31 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:31.172656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:31.173531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:31.179754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.180206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.180984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.181418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.211980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.212425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.212870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lazy-loading 'fault' on Instance uuid e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:00:31.297809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:31.306981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-928cb8a1-82bc-4e17-be6d-8c7047d21776 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 200 len: 1331 microversion: 2.1 time: 0.137821 May 16 17:00:31.307588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 306/608] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:31 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:31.750014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9c170df7-d448-419f-87d5-49be10dea102 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "POST /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.787493 May 16 17:00:31.750668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 303/609] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 17:00:30 2022] POST /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:31.913659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:31.914384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:31.922150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.923769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:31.928343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:31.929053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:32.017377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lazy-loading 'services' on Instance uuid bb86dab5-8d6b-4d24-969a-687c2224d48d {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:00:32.089069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fbb59959-93cb-45c5-bc01-955621e014e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments/a63f98b8-4131-478e-a8be-d2882b59bc67" status: 202 len: 0 microversion: 2.1 time: 0.179243 May 16 17:00:32.090368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 307/610] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:00:31 2022] DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments/a63f98b8-4131-478e-a8be-d2882b59bc67 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:00:32.102057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:32.102843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:32.114654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:32.115810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:32.117122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:32.117861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:32.192006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-e7d281d5-cb8f-4953-82a0-b8ab7e18c94a req-96fe6209-f4be-41c0-a40b-d62872ba5d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384369a3-d514-4873-94eb-c7f9ffc45283", "tag": "72814607-d40d-405f-923f-0e3b33277529"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:32.202242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e7d281d5-cb8f-4953-82a0-b8ab7e18c94a req-96fe6209-f4be-41c0-a40b-d62872ba5d71 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:32.202667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e7d281d5-cb8f-4953-82a0-b8ab7e18c94a req-96fe6209-f4be-41c0-a40b-d62872ba5d71 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:32.217048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-e7d281d5-cb8f-4953-82a0-b8ab7e18c94a req-96fe6209-f4be-41c0-a40b-d62872ba5d71 service nova] Creating event network-changed:72814607-d40d-405f-923f-0e3b33277529 for instance 384369a3-d514-4873-94eb-c7f9ffc45283 on hv-cinder-83998 May 16 17:00:32.223366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-e7d281d5-cb8f-4953-82a0-b8ab7e18c94a req-96fe6209-f4be-41c0-a40b-d62872ba5d71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034823 May 16 17:00:32.224331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 308/611] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:32.292025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:32.301551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cddec238-0ab7-496b-9a8e-001f5b722f33 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.205620 May 16 17:00:32.302411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 304/612] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:32 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:32.324885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:32.325701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:32.331810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:32.332255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:32.333028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:32.333464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:32.348817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 HTTP/1.1 May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:00:32.350466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:00:32.351800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'e21efdaa-3bbe-4f8b-953d-6baaaadb9b53'} May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:00:32.352542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:00:32.353778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:00:32.354882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:00:32.354882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-56b3b2fd-fc5b-4754-a018-9e54680b5e2f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 404 len: 111 microversion: 2.1 time: 0.031127 May 16 17:00:32.354882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 309/613] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:32 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:00:32.361332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1f22ac96-e836-4389-983c-3e497f2fc59e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '.version_select at 0x7feace21fd30>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:32.382054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1f22ac96-e836-4389-983c-3e497f2fc59e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231164811" status: 202 len: 0 microversion: 2.1 time: 0.024501 May 16 17:00:32.382739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 305/614] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 16 17:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231164811 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:00:33.143601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-47b9424d-83b2-4847-ad10-4b34c4fd632f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: .version_select at 0x7feacd89ee50>, body: {"keypair": {"name": "tempest-keypair-975087948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9XdHpRJajKQrhtwp8yDQd+mXg/BrgA3TOz1AdaP1FVfPbmyl/i3RJUFPDnVUF4zvUoLBQstjJo47tbTG6Cq3cQhy2ACAPPB/I/oJELYBJea9usVsCMA3rZK7mQgV7Kkg=="}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:33.163728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-47b9424d-83b2-4847-ad10-4b34c4fd632f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:00:33.167512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-47b9424d-83b2-4847-ad10-4b34c4fd632f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:00:33.190785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-47b9424d-83b2-4847-ad10-4b34c4fd632f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050738 May 16 17:00:33.191958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 310/615] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 17:00:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:33.319241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:33.319867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:33.326784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:33.327461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:33.328252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:33.328925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:33.527071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:33.534598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-48221e8d-7163-4fdd-80fa-3f31395b1ddd tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.219806 May 16 17:00:33.543790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 306/616] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:33 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:34.082368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-842fdb88-c992-49cc-88cb-a48b52df1d02 req-57f94cf8-769c-4079-95b8-0cd5655127bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743bb75d-843c-4cb3-afc5-2d41d95014ec", "name": "network-vif-plugged", "status": "completed", "tag": "2a7d1d6a-6fa8-4026-8d6f-1b9ba05cd9e1"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:34.092666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-842fdb88-c992-49cc-88cb-a48b52df1d02 req-57f94cf8-769c-4079-95b8-0cd5655127bd service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:34.094385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-842fdb88-c992-49cc-88cb-a48b52df1d02 req-57f94cf8-769c-4079-95b8-0cd5655127bd service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:34.107603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-842fdb88-c992-49cc-88cb-a48b52df1d02 req-57f94cf8-769c-4079-95b8-0cd5655127bd service nova] Creating event network-vif-plugged:2a7d1d6a-6fa8-4026-8d6f-1b9ba05cd9e1 for instance 743bb75d-843c-4cb3-afc5-2d41d95014ec on hv-cinder-83998 May 16 17:00:34.114579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-842fdb88-c992-49cc-88cb-a48b52df1d02 req-57f94cf8-769c-4079-95b8-0cd5655127bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 May 16 17:00:34.115396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 311/617] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:34.546865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-298029088", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b"}], "security_groups": [{"name": "tempest-securitygroup--2062198119"}], "key_name": "tempest-keypair-975087948", "user_data": "}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:34.552596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:34.553301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:34.559314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:34.559767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:34.560542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:34.560985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:34.649214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] validate_networks() for [('6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:00:34.693039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:34.700235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d09529e0-f16b-443e-9c71-34c0a3baa242 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.152802 May 16 17:00:34.700803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 312/618] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:34 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:35.014366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:00:35.014796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:00:35.015272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:00:35.015686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:00:35.016091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:00:35.025295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:35.025772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:35.026573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:35.027037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:35.042893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:00:35.046742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:00:35.057332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:00:35.059595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:00:35.105975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-46d0a3f6-4d4e-468a-b904-3c43667c9f8e tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563709 May 16 17:00:35.106854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 307/619] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:00:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:00:35.117236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0478ebdf-7b6b-4e47-8d4c-3192417023da tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:35.117878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0478ebdf-7b6b-4e47-8d4c-3192417023da tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:35.170859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0478ebdf-7b6b-4e47-8d4c-3192417023da tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:35.177991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0478ebdf-7b6b-4e47-8d4c-3192417023da tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1240 microversion: 2.1 time: 0.065226 May 16 17:00:35.178565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 313/620] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:35 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:35.716905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:35.717452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:35.724907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:35.725359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:35.726233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:35.726674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:35.855879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:35.863856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9b2a8d79-ff3b-4033-8e4c-78d3fc34fa9b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1315 microversion: 2.1 time: 0.151328 May 16 17:00:35.865047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 308/621] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:35 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:36.199393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:36.200011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:36.206364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:36.206812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:36.207579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:36.208019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:36.268399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:36.276274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4c18981e-1eee-47b4-8c39-0b87eb801d0f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1236 microversion: 2.1 time: 0.080656 May 16 17:00:36.276850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 314/622] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:36 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:36.881401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:36.882390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:36.889063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:36.889717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:36.890606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:36.891283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.028939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:37.037837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f8dd326a-22f2-4515-a8d1-91347f0cf38d tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1465 microversion: 2.1 time: 0.161155 May 16 17:00:37.038876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 309/623] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:36 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:37.075423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:37.075921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:37.082277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:37.082724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.083490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:37.083924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.108995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:00:37.180818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7c2f5c25-302b-40dd-9dc7-e15269e32813 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "DELETE /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 204 len: 0 microversion: 2.1 time: 0.109131 May 16 17:00:37.181452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 315/624] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:00:37 2022] DELETE /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:00:37.191625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:37.192241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:37.198250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:37.198705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.199481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:37.199922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.293918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:37.294640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:37.302612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:37.303295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.304100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:37.304593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:37.336772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:37.344454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0001da8e-399b-4717-8880-5b94f178049b tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1471 microversion: 2.1 time: 0.158420 May 16 17:00:37.345136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 310/625] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:37 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:37.371730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:37.380514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d9b727e1-67d1-45ef-9e3f-8dd2b0176a37 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1298 microversion: 2.1 time: 0.090998 May 16 17:00:37.381270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 316/626] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:37 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:38.362190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:38.362813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:38.369702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:38.370188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:38.370951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:38.371387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:38.399389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:38.399962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:38.406503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:38.407002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:38.407962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:38.408398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:38.503601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:38.511275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bc02adb2-2908-40a7-83eb-d64aea0dd616 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1471 microversion: 2.1 time: 0.152914 May 16 17:00:38.511860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 311/627] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:38 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:38.548057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:38.555261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aa3d07a6-9fd4-4d9a-88d7-445a0e144f7d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.159743 May 16 17:00:38.555827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 317/628] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:38 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:00:39.534043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:39.536898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:39.553922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:39.554767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:39.555750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:39.557115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:39.573078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:39.573695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:39.589893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:39.590618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:39.591590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:39.592793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:39.737861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:39.743309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:39.747069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3a4ec2bc-84a0-4398-8af2-fc4560bfe20f tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1471 microversion: 2.1 time: 0.222162 May 16 17:00:39.747654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 312/629] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:39 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1471 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:39.750505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4dac463f-1876-4602-a77d-b03f030c4c4d tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.181959 May 16 17:00:39.751069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 318/630] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:39 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:39.755612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-945118f2-4d05-48f2-93f7-a2d2d7d63d8e req-f50cc683-3394-495f-9f20-f0a69ffe986c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cea648-3cec-4a36-b8ee-02d2f4ee9097", "tag": "d3ef85dc-ef25-4d5a-bec4-b5600df4152d"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:39.764313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-945118f2-4d05-48f2-93f7-a2d2d7d63d8e req-f50cc683-3394-495f-9f20-f0a69ffe986c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:39.764844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-945118f2-4d05-48f2-93f7-a2d2d7d63d8e req-f50cc683-3394-495f-9f20-f0a69ffe986c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:39.776352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-945118f2-4d05-48f2-93f7-a2d2d7d63d8e req-f50cc683-3394-495f-9f20-f0a69ffe986c service nova] Creating event network-changed:d3ef85dc-ef25-4d5a-bec4-b5600df4152d for instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 on hv-cinder-83998 May 16 17:00:39.781297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-945118f2-4d05-48f2-93f7-a2d2d7d63d8e req-f50cc683-3394-495f-9f20-f0a69ffe986c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029279 May 16 17:00:39.781949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 313/631] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:40.461615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-9b4628ee-b62a-422b-a18b-668ccd170afd req-871fde97-ba02-48f9-95c8-bdb8abf0634d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743bb75d-843c-4cb3-afc5-2d41d95014ec", "name": "network-vif-deleted", "tag": "2a7d1d6a-6fa8-4026-8d6f-1b9ba05cd9e1"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:40.469626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-9b4628ee-b62a-422b-a18b-668ccd170afd req-871fde97-ba02-48f9-95c8-bdb8abf0634d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:40.470135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-9b4628ee-b62a-422b-a18b-668ccd170afd req-871fde97-ba02-48f9-95c8-bdb8abf0634d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:40.481570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-9b4628ee-b62a-422b-a18b-668ccd170afd req-871fde97-ba02-48f9-95c8-bdb8abf0634d service nova] Creating event network-vif-deleted:2a7d1d6a-6fa8-4026-8d6f-1b9ba05cd9e1 for instance 743bb75d-843c-4cb3-afc5-2d41d95014ec on hv-cinder-83998 May 16 17:00:40.486504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-9b4628ee-b62a-422b-a18b-668ccd170afd req-871fde97-ba02-48f9-95c8-bdb8abf0634d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029077 May 16 17:00:40.487115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 319/632] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:40.765530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:40.766263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:40.767626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:40.768328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:40.773847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:40.774581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:40.775140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:40.775589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:40.775716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:40.776190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:40.776351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:40.776949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:40.816188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:40.817305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:40.817764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lazy-loading 'fault' on Instance uuid 743bb75d-843c-4cb3-afc5-2d41d95014ec {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:00:40.861226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b7ce7aa84c42c0a14351feb37b4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513196f833e447a989898b7daee36ba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:40.868941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7199c91d-243b-44f2-854c-b9cc69a039d0 tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 200 len: 1305 microversion: 2.1 time: 0.108258 May 16 17:00:40.869503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 314/633] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:40 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:40.940913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:40.948779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ae9ab428-3b30-4ee1-862b-e4d45fbcc3ca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.185755 May 16 17:00:40.949355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 320/634] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:40 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:41.885959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:41.886570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] [instance: 743bb75d-843c-4cb3-afc5-2d41d95014ec] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:41.892851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:41.893312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:41.894089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:41.895120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:41.907707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] HTTP exception thrown: Instance 743bb75d-843c-4cb3-afc5-2d41d95014ec could not be found. May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Request method failure captured: May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec HTTP/1.1 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoMcN753Wi4fIW1gVBCgZ7Saw_i5CSX8ZRizzlzTpZ5iS3CsaFJNrmiLf1b8AB43GCxjyPlx2XodGWc-E43aUovUqgvRggHhFtNZcqvShegnds8__7xyFKQ51qDy0B4ctAK5SuH5JeE-D-HmnQtwhKp1wxWyQS6AJViiEHZHt4TUHD4 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 513196f833e447a989898b7daee36ba3 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-379339763 May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:00:41.909294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_513196f833e447a989898b7daee36ba3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/513196f833e447a989898b7daee36ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/513196f833e447a989898b7daee36ba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/513196f833e447a989898b7daee36ba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-379339763 May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 513196f833e447a989898b7daee36ba3 May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-379339763 May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-379339763-project May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 39b7ce7aa84c42c0a14351feb37b4d9d May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-379339763-project May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 743bb75d-843c-4cb3-afc5-2d41d95014ec could not be found. May 16 17:00:41.910832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '743bb75d-843c-4cb3-afc5-2d41d95014ec'} May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743bb75d-843c-4cb3-afc5-2d41d95014ec could not be found. May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:00:41.911674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743bb75d-843c-4cb3-afc5-2d41d95014ec could not be found. May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743bb75d-843c-4cb3-afc5-2d41d95014ec could not be found. May 16 17:00:41.913005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:00:41.914334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] Returning 404 to user: Instance 743bb75d-843c-4cb3-afc5-2d41d95014ec could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:00:41.914334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-811a1053-b539-4834-b3c9-3a234931f9ee tempest-VolumesNegativeTest-379339763 tempest-VolumesNegativeTest-379339763-project] 10.222.0.70 "GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec" status: 404 len: 111 microversion: 2.1 time: 0.028709 May 16 17:00:41.914334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 315/635] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:41 2022] GET /compute/v2.1/servers/743bb75d-843c-4cb3-afc5-2d41d95014ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:00:41.965214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:41.965862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:41.972105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:41.972820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:41.973590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:41.974087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:42.106287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:42.114133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2b6f6810-2798-4ce2-be06-7fe49b2545af tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.152185 May 16 17:00:42.114710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 321/636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:41 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:43.130981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:43.131601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:43.138103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:43.138556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:43.139811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:43.140256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:43.272726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:43.280023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-13516435-a65f-4bea-98cc-1aa4f69600f2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.153146 May 16 17:00:43.280574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 316/637] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:43 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:44.297614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:44.298444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:44.305835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:44.306293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:44.307064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:44.307506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:44.434297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:44.442923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f1edb86f-bc28-4145-a824-672202fd607c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.149889 May 16 17:00:44.443891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 322/638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:44 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:45.460636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:45.461247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:45.467579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:45.468029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:45.468790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:45.469225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:45.596000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:45.603924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b74ed70b-136a-433b-a469-5cb677f9e2bc tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.148179 May 16 17:00:45.604523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 317/639] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:45 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:46.226793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-97c609de-90c0-4511-a820-96156bb5007c req-5c5d2617-09d1-4918-8aff-10aaf11f8424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cea648-3cec-4a36-b8ee-02d2f4ee9097", "name": "network-vif-plugged", "status": "completed", "tag": "d3ef85dc-ef25-4d5a-bec4-b5600df4152d"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:46.234752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-97c609de-90c0-4511-a820-96156bb5007c req-5c5d2617-09d1-4918-8aff-10aaf11f8424 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:46.235204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-97c609de-90c0-4511-a820-96156bb5007c req-5c5d2617-09d1-4918-8aff-10aaf11f8424 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:46.246435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-97c609de-90c0-4511-a820-96156bb5007c req-5c5d2617-09d1-4918-8aff-10aaf11f8424 service nova] Creating event network-vif-plugged:d3ef85dc-ef25-4d5a-bec4-b5600df4152d for instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 on hv-cinder-83998 May 16 17:00:46.251056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-97c609de-90c0-4511-a820-96156bb5007c req-5c5d2617-09d1-4918-8aff-10aaf11f8424 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028918 May 16 17:00:46.251642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 323/640] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:46.621150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:46.621783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:46.629641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:46.630133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:46.630893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:46.631322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:46.757609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:46.764942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9f22c3e9-f8c3-46eb-b54c-89ef710bab81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.147702 May 16 17:00:46.765509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 318/641] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:46 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:47.782581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:47.783200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:47.789392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:47.789874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:47.790640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:47.791074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:47.917378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:47.925213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d83daade-34a4-4690-9547-8cf5aa2be2bd tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1366 microversion: 2.1 time: 0.147287 May 16 17:00:47.925847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 324/642] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:47 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:48.943491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:48.944115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:48.950457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:48.950850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:48.951633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:48.952076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:49.079927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:00:49.088604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f830980-3224-4368-9399-15bc0666a507 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1556 microversion: 2.1 time: 0.148829 May 16 17:00:49.089036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 319/643] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:00:48 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:00:49.105299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:00:49.105905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:00:49.112231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:49.112678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:49.113481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:49.113960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:49.204076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b7c2ca8-9eee-4210-a081-93d96226e097 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102582 May 16 17:00:49.204687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 325/644] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 17:00:49 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:00:50.407816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-c99fc36a-b289-4fca-a22f-f13d56a8639b req-0208ec77-6eb2-454a-a3c1-76dbc36eddde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cea648-3cec-4a36-b8ee-02d2f4ee9097", "tag": "d3ef85dc-ef25-4d5a-bec4-b5600df4152d"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:00:50.417856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-c99fc36a-b289-4fca-a22f-f13d56a8639b req-0208ec77-6eb2-454a-a3c1-76dbc36eddde service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:00:50.418383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-c99fc36a-b289-4fca-a22f-f13d56a8639b req-0208ec77-6eb2-454a-a3c1-76dbc36eddde service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:00:50.429983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-c99fc36a-b289-4fca-a22f-f13d56a8639b req-0208ec77-6eb2-454a-a3c1-76dbc36eddde service nova] Creating event network-changed:d3ef85dc-ef25-4d5a-bec4-b5600df4152d for instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 on hv-cinder-83998 May 16 17:00:50.435152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-c99fc36a-b289-4fca-a22f-f13d56a8639b req-0208ec77-6eb2-454a-a3c1-76dbc36eddde service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031097 May 16 17:00:50.435823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 320/645] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:01:07.389474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:07.390037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:07.395825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:07.396267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:07.397024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:07.397461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:07.428400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-523220b0-d906-456e-97e7-a82828374919 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments/97758427-fbfd-470e-bfef-84f94db93a55" status: 200 len: 194 microversion: 2.20 time: 0.043392 May 16 17:01:07.428986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 326/646] 10.222.0.70 () {60 vars in 1453 bytes} [Mon May 16 17:01:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments/97758427-fbfd-470e-bfef-84f94db93a55 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:07.492737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:07.493324 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:07.500002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:07.500456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:07.501227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:07.501668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:07.620189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lazy-loading 'services' on Instance uuid 066f9c81-9fa1-430d-9691-d04ea3c538de {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:01:07.730140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ea4ff388-d206-4542-932d-440f6771e018 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments/97758427-fbfd-470e-bfef-84f94db93a55" status: 202 len: 0 microversion: 2.20 time: 0.242018 May 16 17:01:07.730836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 321/647] 10.222.0.70 () {60 vars in 1456 bytes} [Mon May 16 17:01:07 2022] DELETE /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments/97758427-fbfd-470e-bfef-84f94db93a55 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 17:01:07.739249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:07.740189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:07.746090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:07.746533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:07.747298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:07.747726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:07.776923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e4ab00e5-4107-4c4d-8481-b64ff87793cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041595 May 16 17:01:07.777724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 327/648] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:01:08.789366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:08.790438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:08.796735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:08.797181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:08.797974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:08.798410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:08.827866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d077641e-d6d5-472b-b730-627507e342ba tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043739 May 16 17:01:08.828432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 322/649] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:09.839968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:09.840906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:09.847495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:09.847945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:09.849376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:09.849849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:09.877169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-74ed6ae6-30f6-48a6-960f-852cff16b052 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041187 May 16 17:01:09.877719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 328/650] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:10.888659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:10.889564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:10.896361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:10.896809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:10.897569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:10.898030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:10.925815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-22f7c9e7-11d6-40b8-b4fd-06b99f33c4fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041195 May 16 17:01:10.926357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 323/651] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:11.937446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:11.938405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:11.944656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:11.945102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:11.945897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:11.946344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:11.974253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5774528c-bf70-4f55-98e2-83f3f7ffb554 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040855 May 16 17:01:11.974793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 329/652] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:12.985040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:12.985990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:12.992742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:12.993189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:12.993982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:12.994414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:13.022115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bcfa254b-2480-4a56-a502-8ce8719e6281 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041030 May 16 17:01:13.022658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 324/653] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:14.033828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:14.034646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:14.041612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:14.042093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:14.042858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:14.043291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:14.071319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5b75b2d4-f048-404f-a4ec-29eb8b9083aa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041610 May 16 17:01:14.071890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 330/654] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:15.083235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:15.084149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:15.090168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:15.090620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:15.091385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:15.091823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:15.120086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e9b7d3ed-953e-47fd-aef1-5cf737fbdec9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041395 May 16 17:01:15.120633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 325/655] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:16.131983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:16.132891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:16.138792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:16.139234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:16.139989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:16.140414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:16.168886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8a153c66-49b4-4503-9e39-523976c5e8d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041057 May 16 17:01:16.169418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 331/656] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:16.781811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c6adc2-8200-4f86-b938-ac0cd263a53b"}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:01:16.782876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:16.789127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:16.789576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:16.790384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:16.790821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:17.049164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f019d4df-d850-4831-ad2f-5e0e4e8a6298 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "POST /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271100 May 16 17:01:17.049864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 326/657] 10.222.0.70 () {60 vars in 1322 bytes} [Mon May 16 17:01:16 2022] POST /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:01:17.181051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:17.182041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:17.188296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:17.188743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:17.189510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:17.189980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:17.218612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b7d3e885-7a37-4e71-ac96-9eb1cff54705 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042020 May 16 17:01:17.219098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 332/658] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:18.231319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:18.232323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:18.238452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:18.239430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:18.240202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:18.240643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:18.273818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7206e585-31f6-4a93-b355-fcf28b643238 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046900 May 16 17:01:18.274380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 327/659] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:19.284511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:19.285423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:19.292211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:19.292656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:19.293414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:19.293875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:19.321569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-07712bc6-bb8b-41cb-b33c-3df0bf3632d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041058 May 16 17:01:19.322155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 333/660] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:20.332720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:20.333623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:20.339830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:20.340273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:20.341026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:20.341458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:20.370051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e971b977-9365-4da7-9ebb-793dabcfe54a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041196 May 16 17:01:20.370610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 328/661] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:21.381662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:21.382611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:21.388793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:21.389243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:21.390032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:21.390465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:21.421381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea5b2b51-22a4-4c8c-9191-6572e63b864e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 May 16 17:01:21.421997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 334/662] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:22.432387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:22.433301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:22.439934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:22.440526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:22.441297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:22.442396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:22.471907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5f30f0c7-007d-4253-82e7-9577bb6752f7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043157 May 16 17:01:22.472466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 329/663] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:23.483370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:23.484276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:23.490697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:23.491137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:23.491887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:23.492315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:23.519764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eaf8e261-a4fd-4e29-a035-c3b44118bf01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040225 May 16 17:01:23.520819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 335/664] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:24.531796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:24.532714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:24.539436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:24.539887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:24.540653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:24.541089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:24.570227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-99a6cdf4-f1bd-4058-aa82-54300b119e28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042324 May 16 17:01:24.570808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 330/665] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:25.581317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:25.582254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:25.589345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:25.589970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:25.590950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:25.591366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:25.620269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da2d49e4-fc11-48dd-868c-a6254dc081e2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042909 May 16 17:01:25.620825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 336/666] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:26.632279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:26.633197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:26.639568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:26.640023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:26.640793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:26.641237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:26.671577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dcf3f4da-5f75-47dc-9023-f0f3273262da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043330 May 16 17:01:26.672137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 331/667] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:27.683621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:27.684542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:27.690813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:27.691265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:27.692027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:27.692465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:27.720543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5f650412-04b7-4ed0-8d95-2837b62428b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040862 May 16 17:01:27.721099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 337/668] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:28.335950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:28.336517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:28.342765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:28.343223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:28.343985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:28.344420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:28.368777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d188a371-d2e2-4eda-b5c5-b773724d17c8 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097/ips" status: 200 len: 149 microversion: 2.1 time: 0.036376 May 16 17:01:28.369341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 332/669] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:01:28 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:01:28.732497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:28.733434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:28.739586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:28.740022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:28.740797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:28.741223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:28.768667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1b55338e-74bd-47a6-9d8c-9240df2cd6b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040096 May 16 17:01:28.769157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 338/670] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:29.780196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:29.781112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:29.787871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:29.788584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:29.789353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:29.789810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:29.817700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3566bd22-37d5-4124-b0f3-bebaef95635a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041486 May 16 17:01:29.818265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 333/671] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:30.829097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:30.830037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:30.836221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:30.836671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:30.837427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:30.837902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:30.867484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2835daf4-626e-4871-97e5-de67c7160175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042272 May 16 17:01:30.868082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 339/672] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:31.879212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:31.880116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:31.886398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:31.886842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:31.887596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:31.888031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:31.916294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bce1d7f6-738d-48bf-89bf-9e74d08bc606 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041003 May 16 17:01:31.916835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 334/673] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:32.928487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:32.929365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:32.935613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:32.936058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:32.936823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:32.937257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:32.964791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7f7fe92-d50c-49ed-acac-280b92065aeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 May 16 17:01:32.965338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 340/674] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:33.977440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:33.978385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:33.984715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:33.985171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:33.985977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:33.986419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:34.013855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76978fd9-1dc1-468e-8333-03d766242fc8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041044 May 16 17:01:34.014419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 335/675] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:35.025143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:35.026089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:35.032322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:35.032769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:35.033527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:35.033999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:35.062932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bb6e322d-1e8b-4fb6-a3c6-9e56e9b488f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041789 May 16 17:01:35.063484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 341/676] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:36.074724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:36.075628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:36.081828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:36.082277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:36.083033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:36.083534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:36.111007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a9734ee6-329e-4ef9-a2a0-463fe658ce56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040210 May 16 17:01:36.111548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 336/677] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:37.123202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:37.124114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:37.130395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:37.130848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:37.131617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:37.132055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:37.159934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9521d389-26f5-4c79-8f1c-87916ddf1498 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040723 May 16 17:01:37.160490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 342/678] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:38.172073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:38.172993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:38.179923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:38.180378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:38.181142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:38.181582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:38.209015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-96819fea-c31e-4ba9-b02a-8bf1be1e425c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040876 May 16 17:01:38.209562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 337/679] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:39.220590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:39.221997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:39.228670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:39.229056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:39.229829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:39.230260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:39.259508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-14ef33ca-a9d9-412c-a40d-68766fe80cad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042641 May 16 17:01:39.260123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 343/680] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:40.271953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:40.272879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:40.279199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:40.279658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:40.280432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:40.280877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:40.309129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-23a5d114-f1ea-4185-a350-175ab0519b49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041734 May 16 17:01:40.309698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 338/681] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:41.322294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:41.323209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:41.329399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:41.329876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:41.330635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:41.331061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:41.358987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6b6f8556-b25f-4a6a-b5c1-fa481d023eaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042219 May 16 17:01:41.359546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 344/682] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:42.370514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:42.371454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:42.377653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:42.378135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:42.378919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:42.379354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:42.407573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fdcf5e72-85a1-4d25-89bb-a0aad479dd3f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040973 May 16 17:01:42.408128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 339/683] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:43.420154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:43.421078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:43.427968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:43.428415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:43.429178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:43.429613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:43.461653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cf98e2ac-99a3-4cb1-a001-d70ce7239d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045891 May 16 17:01:43.462224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 345/684] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:43.997614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:01:43.998237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:44.004478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:44.005434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:44.006235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:44.006668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:44.030719 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lazy-loading 'flavor' on Instance uuid d5c2033c-4fee-4884-a6f7-de043836ebad {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:01:44.101688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12204a59-92b4-4f34-bcaa-8017623b02ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "POST /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad/action" status: 202 len: 0 microversion: 2.1 time: 0.107845 May 16 17:01:44.102290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 340/685] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 17:01:43 2022] POST /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:01:44.110356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:44.111005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:44.116861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:44.117312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:44.118142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:44.118697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:44.411458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:44.419943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cdbce99b-32b9-465a-bcb4-92d668eddaef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.313316 May 16 17:01:44.420527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 346/686] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:44.473200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:44.474261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:44.480266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:44.480711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:44.481467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:44.481952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:44.510444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8c07315f-68d4-450e-9c08-1e3a55a7c9e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041790 May 16 17:01:44.510991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 341/687] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:45.438332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:45.438956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:45.445793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:45.446245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:45.447048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:45.447488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:45.523209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:45.523913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:45.530293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:45.530813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:45.531544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:45.531987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:45.562900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6a56ee4d-43f9-4d97-b072-08b452c4ae5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044762 May 16 17:01:45.563508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 342/688] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:01:45.585250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:45.594044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d62896be-7426-4337-aa9a-e6f666e4e3f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.159957 May 16 17:01:45.594645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 347/689] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:46.611527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:46.612113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:46.618287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:46.618732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:46.619487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:46.619920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:46.682346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:46.683849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:46.689869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:46.690320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:46.691099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:46.691538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:46.720523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b9382417-dce2-48fb-aa0c-e7952da97f5c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148298 May 16 17:01:46.721353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 343/690] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:46.751194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:46.758427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dad9ae62-ea62-4f77-9a19-d6a0ae39cb8d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150681 May 16 17:01:46.758991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 348/691] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:01:47.732924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:47.733829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:47.740791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:47.741236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:47.742034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:47.742476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:47.769969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-63e45f11-05aa-4969-8335-ddb4b6dfa7d5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041027 May 16 17:01:47.770866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 344/692] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:47.775266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:47.775874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:47.782155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:47.782596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:47.783344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:47.783776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:47.908731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:47.916518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e477c947-32c7-4d96-bb09-dd4bc482df2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145165 May 16 17:01:47.917079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 349/693] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:01:48.782954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:48.783814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:48.790131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:48.790582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:48.791342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:48.791780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:48.820162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-776f73dc-c09f-4c09-bf1b-1b955d94994f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041391 May 16 17:01:48.820704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 345/694] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:48.934090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:48.934811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:48.941316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:48.941784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:48.942677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:48.943623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:49.069533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:49.076806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e4475132-3e60-4876-a970-01b7eb1f55c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146584 May 16 17:01:49.077374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 350/695] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:49.831875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:49.832795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:49.839635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:49.840091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:49.840861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:49.841301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:49.869988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bd7c047e-5052-4cae-8b6b-31fe10da6178 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042042 May 16 17:01:49.870573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 346/696] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:50.093693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:50.094325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:50.101440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:50.101914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:50.102673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:50.103112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:50.248255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:50.256146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41ef98a9-052f-48e8-8da4-859d5c67adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.166179 May 16 17:01:50.256734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 351/697] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:50.882553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:50.883380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:50.889553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:50.890036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:50.890793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:50.891230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:50.920760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-54619f06-83ad-4dc3-ab26-590e52189a99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043071 May 16 17:01:50.921369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 347/698] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:51.278357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:51.279315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:51.287681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:51.288211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:51.289060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:51.289720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:51.420443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:51.428348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe1e528c-7b7c-4814-a1b4-d436b78a4a81 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154537 May 16 17:01:51.428918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 352/699] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:51 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:51.932243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:51.933098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:51.939557 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:51.940004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:51.940762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:51.941201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:51.969438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-24212ae7-137a-49d0-b206-9e55226579da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041232 May 16 17:01:51.970015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 348/700] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:52.444795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:52.445351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:52.451605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:52.452057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:52.452828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:52.453266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:52.583055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:52.590503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f9669a87-622e-4567-a004-b0e2c2c66c12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150094 May 16 17:01:52.591074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 353/701] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:52.981377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:52.982254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:52.989514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:52.989988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:52.990754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:52.991185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:53.021413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5b1a9b0b-5b90-4f72-8963-098f4b938bbc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043367 May 16 17:01:53.022003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 349/702] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:53.607130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:53.607791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:53.614103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:53.614554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:53.615321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:53.615759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:53.744385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:53.752015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e7448d77-157e-49e7-a4ef-1c584e3e6951 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148725 May 16 17:01:53.752585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 354/703] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:54.032747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:54.033661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:54.039989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:54.040442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:54.041208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:54.041642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:54.070194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6fb55c32-b3a7-4d02-affd-b8cd37100883 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041688 May 16 17:01:54.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 350/704] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:54.769884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:54.771056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:54.777262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:54.777713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:54.778511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:54.778945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:54.975984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:54.983391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3e1d84d6-d6f0-4471-9167-6f17954c007c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.217422 May 16 17:01:54.983964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 355/705] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:55.081687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:55.082673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:55.089376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:55.089859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:55.090618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:55.091153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:55.120070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-860a2a7d-b83d-41d3-94b2-f9101d3ca594 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042276 May 16 17:01:55.120624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 351/706] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:56.000203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:56.000854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:56.007152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:56.007599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:56.008359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:56.008822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:56.131739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:56.132662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:56.134130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:56.139124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:56.139569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:56.140336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:56.140773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:56.141349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5be7b415-c589-4936-a0e3-95c468a71bc6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145014 May 16 17:01:56.141952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 356/707] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:56.169003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2db17c88-6153-48b9-8513-6a418385b5b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041217 May 16 17:01:56.169546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 352/708] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:01:57.158285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:57.158898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:57.165714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:57.166187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:57.166949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:57.167381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:57.180016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:57.180932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:57.187187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:57.187637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:57.188410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:57.189450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:57.218299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5c95e783-9b94-4e4c-a38b-f90cc65e29df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 May 16 17:01:57.218892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 353/709] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:01:57.300502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:57.307752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7e2d0919-0d49-4d13-a985-8318037919a3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153311 May 16 17:01:57.308314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 357/710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:58.230686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:58.231602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:58.237884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:58.238339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:58.239715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:58.240163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:58.268795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f2110d85-db5a-43ac-b323-6286ee53670f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042069 May 16 17:01:58.269357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 354/711] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:01:58.324196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:58.324816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:58.331134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:58.331582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:58.332350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:58.332833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:58.465044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:58.472507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-564e8c4d-d9a6-4401-8482-a49065bc8aec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152112 May 16 17:01:58.473073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 358/712] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:01:59.280654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:59.281483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:59.288330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:59.288774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:59.289529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:59.289994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:59.318636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e64fdd8f-0e7c-498e-8a5f-1358e6ae885a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042160 May 16 17:01:59.319188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 355/713] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:01:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:01:59.490607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:01:59.491221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:01:59.497475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:59.497960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:59.498719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:01:59.499150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:01:59.626712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:01:59.634528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-40938ef1-ac9d-47d3-95ed-852fb1aab182 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147774 May 16 17:01:59.635102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 359/714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:01:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:00.330361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:00.331285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:00.337494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:00.337997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:00.338761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:00.339196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:00.367499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ccc9d01e-7cdd-4c07-aa99-2d9fc94ddf2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041223 May 16 17:02:00.368057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 356/715] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:00.512826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-97e58da6-7d80-4797-985c-2e3cdf9f5c15 req-10c161e8-e3a7-400f-b71c-90bd6a649784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c2033c-4fee-4884-a6f7-de043836ebad", "name": "network-vif-unplugged", "status": "completed", "tag": "fd7ba01c-f563-4085-b558-b1c5bd0db5a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:02:00.521330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-97e58da6-7d80-4797-985c-2e3cdf9f5c15 req-10c161e8-e3a7-400f-b71c-90bd6a649784 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:00.521755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-97e58da6-7d80-4797-985c-2e3cdf9f5c15 req-10c161e8-e3a7-400f-b71c-90bd6a649784 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:00.533052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-97e58da6-7d80-4797-985c-2e3cdf9f5c15 req-10c161e8-e3a7-400f-b71c-90bd6a649784 service nova] Creating event network-vif-unplugged:fd7ba01c-f563-4085-b558-b1c5bd0db5a6 for instance d5c2033c-4fee-4884-a6f7-de043836ebad on hv-cinder-83998 May 16 17:02:00.538539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-97e58da6-7d80-4797-985c-2e3cdf9f5c15 req-10c161e8-e3a7-400f-b71c-90bd6a649784 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029430 May 16 17:02:00.539124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 360/716] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:02:00.651460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:00.652077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:00.657902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:00.658345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:00.659103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:00.659533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:00.838586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:00.846204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae66277a-37e4-43d3-ada9-2a89db5af1a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.198234 May 16 17:02:00.846762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 357/717] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:01.379989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:01.380982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:01.387032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:01.387478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:01.388230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:01.388662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:01.416849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-95341b60-be6a-4c4a-afe9-a0614a84e7c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041376 May 16 17:02:01.417418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 361/718] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:01.862916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:01.863534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:01.869867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:01.870325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:01.871144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:01.871559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:01.999614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:02.006941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7594b541-802f-4671-9099-2e63c393bb05 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147904 May 16 17:02:02.007507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 358/719] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:02.428627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:02.429703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:02.436338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:02.436781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:02.437534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:02.437997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:02.465640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d5215fd3-5f04-417b-b5d1-7968c8672fd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040999 May 16 17:02:02.466210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 362/720] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:03.024518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:03.025049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:03.031822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:03.032715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:03.033028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:03.033470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:03.158137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:03.165965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2e1de066-2d91-418e-98f1-e4f3fe003921 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145912 May 16 17:02:03.166575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 359/721] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:03.476876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:03.477808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:03.484221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:03.484664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:03.485415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:03.485872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:03.513854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a2c680be-a9a8-4156-b5c2-53f4bc1799da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040955 May 16 17:02:03.514398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 363/722] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:04.182875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:04.183517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:04.189852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:04.190304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:04.191072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:04.191514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:04.323126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:04.330426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4965b09f-3ca3-44e0-9049-cf361b16c44c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151398 May 16 17:02:04.331000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 360/723] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:04.525269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:04.526146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:04.532349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:04.532789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:04.533541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:04.533992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:04.561635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7dc1903b-ba9d-4f06-8c9d-0f406987838f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040371 May 16 17:02:04.562205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 364/724] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:05.346707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:05.347332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:05.354330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:05.354775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:05.355534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:05.355961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:05.481649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:05.488860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-013eeda2-84e4-422b-beb6-d82e654bb766 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146225 May 16 17:02:05.489425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 361/725] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:05.573512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:05.574447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:05.580634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:05.581072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:05.581864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:05.582290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:05.611745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3c4de829-5d39-4eee-9794-da7132ca48fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042132 May 16 17:02:05.612222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 365/726] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:06.506345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:06.506961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:06.513336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:06.513803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:06.514562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:06.514991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:06.623418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:06.624339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:06.631064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:06.631519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:06.632291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:06.632729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:06.648204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:06.655501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cedd2528-abf4-49cc-be12-019d0fa7b3ee tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153495 May 16 17:02:06.656070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 362/727] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:06.661832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-532cb745-381f-45a4-99c2-345630348aad tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042351 May 16 17:02:06.662643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 366/728] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:07.673004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:07.673530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:07.673957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:07.674231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:07.679940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:07.680328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:07.680448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:07.680777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:07.681145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:07.681535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:07.681644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:07.681995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:07.710442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-607e1052-3ae9-4208-ad21-f346f720162f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041089 May 16 17:02:07.711009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 367/729] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:07.811394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:07.818606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12ad3b47-d4b5-4e6f-914b-976a1b8c5ccf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149576 May 16 17:02:07.819187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 363/730] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:08.722286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:08.723205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:08.729981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:08.730429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:08.731185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:08.731619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:08.759998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0c9c0833-1fe4-41be-accf-e75a0684e61d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041976 May 16 17:02:08.760552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 368/731] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:08.835478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:08.836081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:08.842452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:08.842897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:08.843649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:08.844077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:08.968639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:08.976541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0a512ff3-17d9-4a05-9d89-04979373a37d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144876 May 16 17:02:08.977108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 364/732] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:09.772620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:09.773470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:09.779760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:09.780205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:09.780960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:09.781389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:09.809293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c5f656b4-d95b-4893-a920-b404f2c25743 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041237 May 16 17:02:09.809875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 369/733] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:09.993542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:09.994193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:10.000445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:10.000890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:10.001649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:10.002117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:10.129077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:10.136795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7d848921-30ab-476a-b226-b45ad5b52876 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147108 May 16 17:02:10.137354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 365/734] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:10.821062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:10.822001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:10.828198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:10.828648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:10.829407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:10.829874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:10.858922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a076e659-4017-454c-ae04-3fdf1f262c13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042273 May 16 17:02:10.859595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 370/735] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:11.154011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:11.154625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:11.161360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:11.161836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:11.162594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:11.163026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:11.286700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:11.294103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-300d4093-a54a-4ba0-b986-160f3338231b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.143945 May 16 17:02:11.294664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 366/736] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:11.870906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:11.871823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:11.878109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:11.878557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:11.879314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:11.879748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:11.908757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-029640fb-cce9-4772-bfe7-6a725064e9bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041856 May 16 17:02:11.909306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 371/737] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:12.310411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:12.310973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:12.317238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:12.318310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:12.319084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:12.319523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:12.447635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:12.454954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-140fec0f-6d2e-45b4-b16b-cba9f3aa19e0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148482 May 16 17:02:12.455520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 367/738] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:12.920361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:12.921269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:12.927805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:12.928248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:12.929116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:12.929543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:12.978318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-704223a0-5c81-449c-99d8-2fdcfda64933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061719 May 16 17:02:12.978808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 372/739] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:13.471425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:13.472043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:13.478800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:13.479251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:13.480015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:13.480450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:13.609803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:13.617030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2f413fc6-fb33-49c1-8672-6c554217a722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149766 May 16 17:02:13.617598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 368/740] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:13.989878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:13.990785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:13.996944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:13.997391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:13.998179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:13.998626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:14.027089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4cdd764a-3565-40eb-a7dc-c6e1cb3bef7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041206 May 16 17:02:14.027632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 373/741] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:14.634566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:14.635203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:14.641488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:14.641980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:14.642742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:14.643178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:14.766977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:14.774733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-afdddade-6d06-414a-8249-d5fe7a2025a9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144671 May 16 17:02:14.775301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 369/742] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:15.039774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:15.040609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:15.046516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:15.046958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:15.047711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:15.048141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:15.075728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-415f737a-996f-4012-a162-7be3dc846716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040804 May 16 17:02:15.076288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 374/743] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:15.792240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:15.792799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:15.798925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:15.799380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:15.800156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:15.800602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:15.929341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:15.936829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-61713335-2967-40b6-ab17-d0cf689d205a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148610 May 16 17:02:15.937397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 370/744] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:16.086553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:16.087464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:16.093649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:16.094130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:16.094890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:16.095326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:16.123438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17ed177a-3250-45bd-a75a-5f42bfe39f22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040885 May 16 17:02:16.123987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 375/745] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:16.953910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:16.954458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:16.961367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:16.961844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:16.962606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:16.963036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:17.087385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:17.094568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8ffe6937-9640-47e5-9c21-06b465181027 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144706 May 16 17:02:17.095164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 371/746] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:17.135002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:17.135913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:17.142086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:17.142532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:17.143290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:17.143722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:17.171645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-64dca5ec-a832-4fdc-a613-f5cfb9461f49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040585 May 16 17:02:17.172187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 376/747] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:18.112282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:18.112927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:18.119267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:18.119718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:18.120489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:18.120913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:18.183558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:18.184496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:18.190621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:18.191063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:18.191826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:18.192278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:18.220930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b9a94c0-6b46-4ab7-9712-beb054dfd425 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041122 May 16 17:02:18.221492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 377/748] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:18.250387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:18.257977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-18e2f9e1-2c0d-4eaa-92d5-fc8c61af35db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149571 May 16 17:02:18.258545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 372/749] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:02:19.233242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:19.234187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:19.240609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:19.241051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:19.241869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:19.242298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:19.270882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f3bbdda7-c4d1-4cdb-bf78-2c78b754be99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040966 May 16 17:02:19.271438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 378/750] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:19.275383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:19.275996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:19.282319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:19.282768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:19.283534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:19.283968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:19.409129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:19.417092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-869ce7cd-d812-4d9b-8fa4-9e1d09ba745f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145527 May 16 17:02:19.417666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 373/751] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:20.281996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:20.282934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:20.289817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:20.290270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:20.291028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:20.291459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:20.318883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe3d0bb1-70e7-48f3-a44c-bdf076ac9a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 May 16 17:02:20.319436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 379/752] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:20.434061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:20.434681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:20.441044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:20.441500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:20.442955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:20.443396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:20.576232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:20.585009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-78d00964-2fd2-43d7-9f4a-b19926aec496 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154862 May 16 17:02:20.585585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 374/753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:21.330637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:21.331548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:21.338710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:21.339183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:21.339950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:21.340392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:21.369572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d765594-6dc7-4cf1-8762-a73973fda33d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042961 May 16 17:02:21.370154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 380/754] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:21.603039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:21.603567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:21.609500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:21.609979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:21.610748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:21.611179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:21.739711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:21.746997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c0873005-f04d-4a3e-85cd-c2ab8d303be9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148913 May 16 17:02:21.747573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 375/755] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:22.380391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:22.381321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:22.387566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:22.388013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:22.388767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:22.389196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:22.418088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f8affd3-72ef-4043-b50b-8a0d9a8dc17a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041547 May 16 17:02:22.418771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 381/756] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:22.764486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:22.765125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:22.771951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:22.772393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:22.773149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:22.773580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:22.896362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:22.903512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5f64e387-1d34-4671-b1db-7f958dc32ba6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.142870 May 16 17:02:22.904077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 376/757] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:23.430550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:23.431470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:23.437726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:23.438214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:23.438979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:23.439418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:23.468421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4aa1c2b5-d1cc-4532-8fb0-66b840733c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042769 May 16 17:02:23.468982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 382/758] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:23.920444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:23.921054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:23.927402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:23.927849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:23.928604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:23.929036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:24.058498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:24.065821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-91518746-c6bd-46f5-87dd-8fa3f2799fa0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149301 May 16 17:02:24.066388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 377/759] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:24.480429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:24.481374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:24.487570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:24.488009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:24.488761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:24.489822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:24.517380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b464ae4a-6af7-40c4-b4f8-0b37f34e24a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040848 May 16 17:02:24.518197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 383/760] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:25.084052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:25.084670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:25.091187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:25.091642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:25.092408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:25.092845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:25.216905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:25.224436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a7483ce7-ed4b-4311-aa81-79e3d3ae7fd8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144813 May 16 17:02:25.225009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 378/761] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:25.528562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:25.529512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:25.536393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:25.536824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:25.537586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:25.538047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:25.565328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cc69cd78-1303-442d-9a1f-5e08721604c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040780 May 16 17:02:25.565898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 384/762] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:26.240998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:26.241613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:26.247941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:26.248389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:26.249150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:26.249585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:26.376050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:26.383333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e32a199d-10f1-4261-859d-608798bc299e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146848 May 16 17:02:26.383900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 379/763] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:26.576251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:26.577087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:26.583878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:26.584335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:26.585092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:26.585528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:26.613653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41b4e9ef-f7b1-4ff1-a8b9-40fd4323b1b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041556 May 16 17:02:26.614734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 385/764] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:27.399446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:27.400061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:27.406509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:27.406962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:27.407733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:27.408169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:27.536019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:27.543215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e5e88734-ab55-4b41-a005-8782a82ea8af tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147684 May 16 17:02:27.543783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 380/765] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:27.625860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:27.626780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:27.633440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:27.633924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:27.634690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:27.635121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:27.667491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-827b437e-7176-4f25-9834-e503f30839a7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045525 May 16 17:02:27.667994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 386/766] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:28.560526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:28.561135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:28.567579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:28.568030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:28.568782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:28.569212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:28.679833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:28.680769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:28.687296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:28.687843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:28.688618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:28.689047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:28.696483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:28.704573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ee4cb887-58cf-4365-b2b3-fe96329a4e40 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147663 May 16 17:02:28.705307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 381/767] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:28.718924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-464b9c5b-8128-4375-b4f0-7c34e160a39f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043729 May 16 17:02:28.719483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 387/768] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:29.722037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:29.722582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:29.729183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:29.729630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:29.730426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:29.730656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:29.731064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:29.731582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:29.737764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:29.738216 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:29.738986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:29.739427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:29.768363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6738e00b-8cf1-42b0-ab3c-f983c572f82b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041574 May 16 17:02:29.768943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 388/769] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:29.862600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:29.869906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d5535c3f-f846-4da9-a926-73db681d385e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152233 May 16 17:02:29.870473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 382/770] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:30.781818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:30.782733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:30.790034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:30.790487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:30.791251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:30.791684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:30.820390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-80813c94-78b8-4c2f-962f-45ab24f21b8f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042554 May 16 17:02:30.820978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 389/771] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:30.885885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:30.886487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:30.892707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:30.893152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:30.893946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:30.894458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:31.018329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:31.026031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5925dcb9-2cc0-4963-b0f7-b396a1d14aa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144012 May 16 17:02:31.026589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 383/772] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:31.832762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:31.833682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:31.839966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:31.840410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:31.841170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:31.841608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:31.870766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4eb7b225-b20d-463d-a3f6-dcbf147184fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042557 May 16 17:02:31.871323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 390/773] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:32.043751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:32.044368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:32.050754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:32.051855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:32.052624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:32.053068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:32.420933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:32.428654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b593d522-3e4b-49b7-a1fa-734521fa4a2b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.388767 May 16 17:02:32.429219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 384/774] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:32.883242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:32.884180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:32.890433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:32.890880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:32.891635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:32.892066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:32.919972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0d7f5663-c8ca-4677-9368-8964ecd26137 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040725 May 16 17:02:32.920549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 391/775] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:33.446487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:33.447104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:33.453632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:33.454138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:33.454924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:33.455398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:33.580195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:33.588074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bd8bef9a-2375-485c-82ab-aba6cc69a00b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145458 May 16 17:02:33.588635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 385/776] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:33.931843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:33.932755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:33.939075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:33.939521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:33.940282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:33.940718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:33.968596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1c2441ca-9325-4b04-b6b3-7112eccb3656 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040695 May 16 17:02:33.969142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 392/777] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:34.605388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:34.606043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:34.615079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:34.615526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:34.616483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:34.616920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:34.749496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:34.757478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-52c977aa-e38d-484d-b34c-017c89bd3afc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.156116 May 16 17:02:34.758086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 386/778] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:34.982683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:34.983767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:34.990819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:34.991263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:34.992022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:34.992450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:35.020042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8488d075-b035-48f0-8739-c6a3b8b3262c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041972 May 16 17:02:35.020601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 393/779] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:35.775138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:35.775672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:35.782064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:35.782519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:35.783293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:35.783734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:35.912051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:35.919369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6b7dd902-ef9b-4fe7-9c59-0010266e5177 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148210 May 16 17:02:35.919942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 387/780] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:36.032019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:36.032883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:36.039866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:36.040322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:36.041097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:36.041541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:36.069792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17ae1c0d-cb94-4365-a051-fc4e226705b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041846 May 16 17:02:36.070363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 394/781] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:36.936978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:36.937563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:36.943790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:36.944240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:36.945003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:36.945441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:37.073026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:37.080573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:37.081111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f169ed47-bf99-4c1c-ac26-5580995c0bda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147587 May 16 17:02:37.081411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 388/782] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:37.081521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:37.089231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:37.089685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:37.090493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:37.090933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:37.119801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-209fa1ef-ea22-4dc2-94f8-d1bb50d3cd09 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043290 May 16 17:02:37.120360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 395/783] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:38.097700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:38.098371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:38.104668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:38.105121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:38.105919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:38.106358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:38.132770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:38.133681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:38.139886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:38.140330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:38.141085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:38.141512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:38.171258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4c2e0fc6-6ef0-49a1-a607-57b631d51ab4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043439 May 16 17:02:38.171831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 396/784] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:38.236022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:38.243987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f101d280-a517-4bb5-a77b-f36358f61d6b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150391 May 16 17:02:38.244560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 389/785] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:39.183670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:39.184687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:39.190900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:39.191440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:39.192806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:39.193239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:39.221769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-308c4c5c-e63a-4e8e-a6bb-285ff0ce1673 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042149 May 16 17:02:39.222349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 397/786] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:39.260993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:39.261522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:39.268311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:39.268764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:39.269547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:39.270013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:39.405452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:39.413589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5fa28ca2-9777-4836-84d2-c9a1db5b03c8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.156494 May 16 17:02:39.414198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 390/787] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:40.233764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:40.234672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:40.241487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:40.241976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:40.242739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:40.243182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:40.270631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-202f3d57-d8c3-4112-95f6-020cd51bf222 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040918 May 16 17:02:40.271182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 398/788] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:40.431232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:40.431850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:40.438184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:40.438635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:40.439409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:40.439846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:40.567273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:40.574531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4eab4798-865b-49de-9d10-e646c93ceef4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147213 May 16 17:02:40.575090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 391/789] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:41.282074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:41.282916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:41.289828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:41.290283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:41.291059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:41.291489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:41.319086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1d024acf-a584-472b-9c32-e2762cbdfa13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041214 May 16 17:02:41.319642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 399/790] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:41.591323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:41.591938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:41.598471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:41.598925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:41.599689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:41.600124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:41.726203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:41.733462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6ee22e2c-12d7-4e28-9bb1-173a4c34d6b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146013 May 16 17:02:41.734060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 392/791] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:42.331256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:42.332209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:42.338128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:42.338572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:42.339341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:42.339773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:42.367938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ef45bc32-3352-4136-ae9a-f97dcb35cc1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041116 May 16 17:02:42.368506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 400/792] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:42.751516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:42.752131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:42.758422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:42.758875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:42.759643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:42.760077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:42.886656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:42.894017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5bea5bdd-8078-4521-a09d-8b191d0af8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146540 May 16 17:02:42.894586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 393/793] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:43.379750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:43.380659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:43.386847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:43.387290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:43.388047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:43.388477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:43.416688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6327fa26-e211-49a3-997f-fc21925276d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040887 May 16 17:02:43.417242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 401/794] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:43.912088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:43.912709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:43.918994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:43.919451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:43.920226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:43.920668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:44.047463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:44.054735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c7e279c1-09b5-42fb-871a-71e509a0ff07 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146760 May 16 17:02:44.055298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 394/795] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:02:44.428729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:44.429644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:44.435861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:44.436308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:44.437071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:44.437829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:44.466136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1ecef9f0-9b74-4b66-a4b1-8945cecd61bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041400 May 16 17:02:44.466685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 402/796] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:45.071881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:45.072441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:45.078271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:45.078731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:45.079498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:45.079935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:45.205078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:45.212412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d98d2856-2da6-41f9-80d1-42943749baa7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145349 May 16 17:02:45.213008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 395/797] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:45.478388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:45.479314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:45.485611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:45.486162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:45.486934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:45.487384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:45.515485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4f4ea6b4-0f18-4df8-90ec-837fefe62672 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041162 May 16 17:02:45.516062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 403/798] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:46.229576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:46.230212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:46.236705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:46.237154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:46.237959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:46.238395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:46.367853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:46.375110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0b4985d-2ff5-4f2d-ae70-eaa3990abe72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149425 May 16 17:02:46.375681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 396/799] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:46.526698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:46.527540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:46.533970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:46.534423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:46.535189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:46.535624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:46.563963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d60b6034-0760-4ab6-89d0-b12048b53ad6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041286 May 16 17:02:46.564514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 404/800] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:47.392445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:47.393056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:47.399845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:47.400300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:47.401099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:47.401534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:47.531066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:47.538419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1bc6d27b-4a55-4a0a-a677-1de95efdd141 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149851 May 16 17:02:47.538983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 397/801] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:47.576150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:47.577061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:47.583368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:47.583819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:47.584582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:47.585017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:47.612557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e031218a-718a-4284-9c67-337eb2c702f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040414 May 16 17:02:47.613098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 405/802] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:48.554421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:48.555041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:48.561391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:48.561888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:48.562666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:48.563106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:48.624819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:48.625729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:48.632458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:48.632898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:48.633662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:48.634124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:48.664206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-80f054fa-f7e8-468d-89e6-de3ef68bd94a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043445 May 16 17:02:48.665137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 406/803] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:48.693477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:48.700731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-67a0bce9-4057-4e25-9156-fda100bc1c2f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150159 May 16 17:02:48.701306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 398/804] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:49.675898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:49.676718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:49.683076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:49.683522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:49.684272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:49.684704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:49.712468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da4256fc-e37e-4091-84a4-4d7eea4a161f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040596 May 16 17:02:49.713178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 407/805] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:49.718227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:49.718838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:49.726832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:49.727284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:49.728050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:49.728485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:49.854174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:49.861459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-79352890-19c3-46d2-8eda-0232ddb82d01 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146987 May 16 17:02:49.862077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 399/806] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:50.724757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:50.725769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:50.732070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:50.732523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:50.733269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:50.733697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:50.761338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-86de6928-c5d7-4546-a5f4-dcc328c1dba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040689 May 16 17:02:50.761924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 408/807] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:50.879429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:50.880087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:50.886399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:50.886851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:50.887618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:50.888057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:51.013295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:51.021205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a680e422-7a09-4e81-8de7-fab63488e2b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146134 May 16 17:02:51.021862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 400/808] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:51.772979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:51.773922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:51.780138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:51.780588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:51.781358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:51.781821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:51.809832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5ad4854c-97ad-4899-8c98-0fd80c203eeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040885 May 16 17:02:51.810382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 409/809] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:52.038167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:52.038692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:52.044916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:52.045362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:52.046192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:52.046611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:52.176594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:52.183763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-29f3a0f4-ca4b-421e-a171-5654dd4f626f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149489 May 16 17:02:52.184334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 401/810] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:52.820483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:52.821393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:52.827664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:52.828112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:52.828875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:52.829310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:52.858158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7e455a6d-9e4e-4c38-9006-c4674fe5377f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041631 May 16 17:02:52.858722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 410/811] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:53.200532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:53.201139 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:53.207847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:53.208012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:53.208692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:53.209129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:53.351995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:53.362445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-92bef871-879f-42ec-a8c0-76ceeabb7150 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.165864 May 16 17:02:53.363029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 402/812] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:53.869996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:53.870912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:53.877141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:53.877592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:53.878392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:53.879335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:53.907417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a7dcab0d-2ec9-435d-a38e-f02de489b10a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041502 May 16 17:02:53.907977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 411/813] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:54.378590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:54.379702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:54.385969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:54.386411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:54.387172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:54.387603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:54.516206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:54.524018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1bcd1fd0-c6f6-4811-a8dc-a1eb3e42feeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149241 May 16 17:02:54.524596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 403/814] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:54.919418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:54.920324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:54.927223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:54.927679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:54.928441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:54.928878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:54.956795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-decb0314-d31d-4b70-ad77-71c9c4e57725 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041407 May 16 17:02:54.957343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 412/815] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:55.540941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:55.541547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:55.547787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:55.548233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:55.548989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:55.549420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:55.680612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:55.688254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eb47837a-7c7b-4f2b-b07b-d4a1ca63fbd3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151161 May 16 17:02:55.688813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 404/816] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:55.968637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:55.969470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:55.976178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:55.976632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:55.977402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:55.977877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:56.005986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9f39a3ee-af92-407b-a2af-100a45818a5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041406 May 16 17:02:56.006531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 413/817] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:56.705210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:56.705863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:56.713031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:56.713487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:56.714310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:56.714737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:56.850233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:56.857484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-58617bdd-613c-4cfa-8761-64afe7720826 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.156198 May 16 17:02:56.858102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 405/818] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:57.017655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:57.018554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:57.024758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:57.025202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:57.026001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:57.026438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:57.054645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d25644e3-06ca-454a-a07f-9834e4fbbdde tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041054 May 16 17:02:57.055207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 414/819] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:02:57.874743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:57.875358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:57.881611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:57.882092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:57.882864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:57.883299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:58.010584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:58.020520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fbbe7adf-048f-4671-954f-cd8d9dff81bb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149668 May 16 17:02:58.021089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 406/820] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:02:58.066189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:58.067137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:58.073311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:58.073785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:58.074550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:58.074995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:58.104653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-15d8be2d-a009-400b-b5dd-2563775f45db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042413 May 16 17:02:58.105208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 415/821] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:59.037941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:59.038547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:59.044795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:59.045238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:59.046029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:59.046458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:59.117170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:02:59.118017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:02:59.124182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:59.124624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:59.125380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:02:59.125833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:02:59.153777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-49d07659-f88c-4ede-9e82-4199bb2dba56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041260 May 16 17:02:59.154344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 416/822] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:02:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:02:59.173964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:02:59.181965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-20cf13f6-f993-482f-bc5a-1effc9e35edf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148353 May 16 17:02:59.182541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 407/823] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:02:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:00.165119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:00.166342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:00.172538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:00.172980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:00.173752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:00.174252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:00.203809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-13507881-74e2-4a8d-9863-6cfece412757 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042609 May 16 17:03:00.204374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 417/824] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:00.294235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:00.294936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:00.300687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:00.301140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:00.301936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:00.302375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:00.438341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:00.446201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9b32ccbd-f91a-4668-b63f-b135d6c304b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.251685 May 16 17:03:00.446766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 408/825] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:03:01.215368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:01.216276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:01.222767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:01.223211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:01.224790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:01.225228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:01.253517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-af93699d-c66c-4643-b73c-9a2f5c48bc28 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042129 May 16 17:03:01.254103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 418/826] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:01.463776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:01.464399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:01.471058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:01.471449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:01.472202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:01.472633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:01.603796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:01.611159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ad384d6f-eadc-4e1d-8da0-e24578b72aaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151249 May 16 17:03:01.611723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 409/827] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:02.265184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:02.266111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:02.275725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:02.276202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:02.277785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:02.278228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:02.306421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1cd1ed48-31f4-4e66-a7d7-b0ed3dd2a68a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045190 May 16 17:03:02.307001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 419/828] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:02.628201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:02.628812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:02.635044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:02.635493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:02.636248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:02.636681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:02.764622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:02.771834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cbe723c4-8295-4d31-be08-3a171bde14d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147490 May 16 17:03:02.772396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 410/829] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:03.318694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:03.319514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:03.325716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:03.326181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:03.326929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:03.327616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:03.356231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cb140285-63c8-46f2-b7a7-32079251e904 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041645 May 16 17:03:03.356775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 420/830] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:03.788866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:03.789491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:03.795709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:03.796159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:03.796917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:03.797346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:03.923365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:03.931770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5533c894-4984-461d-a6b0-c8970c08bf4e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146668 May 16 17:03:03.932358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 411/831] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:04.369224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:04.370169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:04.376359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:04.376800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:04.377558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:04.378011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:04.405120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-58177faa-48e2-4799-8bbd-429f4ea2fa90 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041617 May 16 17:03:04.405674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 421/832] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:04.948334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:04.948937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:04.955260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:04.955710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:04.956867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:04.957547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:05.085156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:05.092389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cdb28885-c5a8-4950-8599-dec15b0b3513 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147972 May 16 17:03:05.092950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 412/833] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:05.417219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:05.418168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:05.424421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:05.424866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:05.425627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:05.426088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:05.453473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-11d09fb6-e8b8-4cb1-8c50-627f05f4efa4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040279 May 16 17:03:05.454068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 422/834] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:06.110164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:06.110780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:06.117574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:06.118044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:06.118832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:06.119261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:06.248090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:06.256041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-37d7091d-62aa-415a-8b3f-b6d531aa7816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149710 May 16 17:03:06.256612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 413/835] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:06.465096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:06.466071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:06.472617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:06.473063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:06.474345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:06.474805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:06.502837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e760ba4c-fe17-42af-b14d-2b0f11ca7d00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041732 May 16 17:03:06.503384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 423/836] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:07.273510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:07.274151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:07.280523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:07.280976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:07.281818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:07.282204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:07.410482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:07.418384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-58c6699d-14cf-43ec-a665-593f484a983d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148903 May 16 17:03:07.418950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 414/837] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:07.514058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:07.514964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:07.521645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:07.522121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:07.522892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:07.523303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:07.551489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fefb9652-f392-4579-8edb-b9dbc2e1afb9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041341 May 16 17:03:07.551970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 424/838] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:08.436450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:08.437062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:08.444029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:08.444483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:08.445254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:08.445692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:08.563152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:08.564068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:08.571684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:08.572140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:08.572913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:08.573349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:08.575171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:08.583189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c5c430a9-1753-4a48-aaf6-241ae1aae089 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150558 May 16 17:03:08.583783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 415/839] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:08.603271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dd1824f9-192d-4c25-b5d8-4119d794bb6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044030 May 16 17:03:08.603832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 425/840] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:09.600573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:09.601185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:09.607777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:09.608231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:09.608999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:09.609431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:09.617059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:09.617999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:09.624253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:09.624726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:09.625526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:09.625992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:09.659093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-549a05b8-63a7-4e1c-94cb-e952350c8b14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048138 May 16 17:03:09.659673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 426/841] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:09.746864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:09.754175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-468b8785-a6cc-4b3a-ace1-99cbc5ed5ceb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.157410 May 16 17:03:09.755344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 416/842] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:10.670998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:10.671825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:10.678576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:10.679030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:10.679797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:10.680232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:10.708879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-69cda7e4-2f28-453a-abb0-0f3773373ba3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 May 16 17:03:10.709438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 427/843] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:10.770792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:10.771398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:10.777573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:10.778050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:10.778806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:10.779232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:10.907922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:10.915825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76f8ab59-fb54-46f7-a54e-cb840cd4706e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148865 May 16 17:03:10.916405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 417/844] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:11.720943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:11.721811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:11.728514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:11.728981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:11.729756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:11.730185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:11.758355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-29a01556-d9a3-4314-ac32-ff95088bf038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041823 May 16 17:03:11.758905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 428/845] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:11.933407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:11.934050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:11.940331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:11.940787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:11.941561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:11.942036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:12.067757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:12.075149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c13b26f6-2137-4870-9cf1-3014f9e8f5ca tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145690 May 16 17:03:12.075735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 418/846] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:12.770244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:12.771150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:12.777382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:12.777865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:12.778638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:12.779070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:12.807279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e3230949-200f-4186-8f93-2b04adf7c177 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041334 May 16 17:03:12.807819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 429/847] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:13.092383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:13.093007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:13.100117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:13.100574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:13.101345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:13.101809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:13.227219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:13.234450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9b6e797f-d770-436e-a48a-889125840a5e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146002 May 16 17:03:13.235021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 419/848] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:13.818302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:13.819125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:13.825450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:13.825945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:13.826699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:13.827145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:13.857075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-81fc3cee-e837-4f7c-9117-ebbd9bfb15da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042852 May 16 17:03:13.857651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 430/849] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:14.252009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:14.252627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:14.259524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:14.259977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:14.260744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:14.261185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:14.394206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:14.401471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bcca9f67-3cec-46c4-aff6-327f0c7d4051 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153322 May 16 17:03:14.402074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 420/850] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:03:14.868647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:14.869567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:14.875373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:14.875821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:14.876578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:14.877014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:14.905463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4d1878d7-53a9-4178-a5cb-05769cfd5634 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040916 May 16 17:03:14.906049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 431/851] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:15.418564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:15.419180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:15.425424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:15.425912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:15.427340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:15.427771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:15.554309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:15.561422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-85830708-b132-4b42-8a65-19ac6415551f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146716 May 16 17:03:15.562014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 421/852] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:15.917600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:15.918614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:15.924930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:15.925376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:15.926171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:15.926604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:15.956786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-62f82c09-e277-4a21-bb9c-6c4a644db90b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043137 May 16 17:03:15.957889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 432/853] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:16.578501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:16.579142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:16.585520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:16.586009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:16.586774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:16.587207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:16.717125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:16.724772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-82101416-3a76-409e-8f76-19532007647f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150124 May 16 17:03:16.725509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 422/854] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:16.969828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:16.970665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:16.977406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:16.977887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:16.978677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:16.979107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:17.007206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-349022d2-956d-4436-b0d6-f79ce924495b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041819 May 16 17:03:17.007749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 433/855] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:17.741970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:17.742489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:17.748960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:17.749407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:17.750198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:17.750631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:17.877628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:17.885479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-db6e858f-efae-4117-9e70-a9645163215c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147487 May 16 17:03:17.886087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 423/856] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:18.018744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:18.019586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:18.026333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:18.026788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:18.027555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:18.027993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:18.056105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a86c8f79-bf04-446a-8a1b-b9ec7acfd362 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041365 May 16 17:03:18.056664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 434/857] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:18.498727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:03:18.498910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:03:18.901858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:18.902535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:18.909529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:18.910010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:18.911617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:18.912386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:19.039314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:19.046679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9513cc1e-913e-406d-a779-512650da1f53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148797 May 16 17:03:19.047240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 424/858] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:19.068310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:19.069228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:19.075459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:19.075914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:19.076681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:19.077121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:19.106205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8c137f65-e8f9-458e-a8ba-105813da4667 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042413 May 16 17:03:19.106771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 435/859] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:20.064209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:20.064752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:20.071552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:20.072007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:20.072777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:20.073221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:20.117087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:20.118031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:20.124265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:20.124718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:20.125490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:20.125961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:20.155056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8f615801-91aa-4990-9c6b-cc268359f365 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041867 May 16 17:03:20.155631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 436/860] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:20.204101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:20.211959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c0086c63-6f44-458a-badb-7f7a32d1a324 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151670 May 16 17:03:20.212532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 425/861] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:21.167828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:21.168739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:21.175020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:21.175470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:21.176227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:21.176659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:21.203980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f2fa7e55-99e1-401d-9ba2-c39ff385ea4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040569 May 16 17:03:21.204528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 437/862] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:21.228761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:21.229375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:21.235576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:21.236028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:21.236791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:21.237226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:21.364241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:21.371465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aed1c3e4-339b-4416-9027-a1dee8ca2573 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146505 May 16 17:03:21.372029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 426/863] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:22.215498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:22.216417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:22.222924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:22.223373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:22.224128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:22.224730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:22.251861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-21c5c082-35e2-40cb-a055-d7ed571dac4f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040445 May 16 17:03:22.252399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 438/864] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:22.388330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:22.388945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:22.395940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:22.396389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:22.397158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:22.397597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:22.528333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:22.535622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a0b3b933-e517-47bb-88e3-a31c9a96dd53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151143 May 16 17:03:22.536192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 427/865] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:23.264042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:23.264958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:23.271695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:23.272145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:23.272905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:23.273337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:23.305912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9f2259e6-e475-49fd-9c56-36826c8a1c1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045419 May 16 17:03:23.306772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 439/866] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:23.552876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:23.553392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:23.559672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:23.560119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:23.560876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:23.561309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:23.690784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:23.697964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-facf4e7b-4f78-426c-b1aa-27f10061b29b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149479 May 16 17:03:23.698535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 428/867] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:24.318802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:24.319720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:24.326040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:24.326489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:24.327247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:24.327682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:24.356502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5cbc397e-9f27-49bc-bc3d-0e9cbc8ec24a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042289 May 16 17:03:24.357054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 440/868] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:24.714801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:24.715435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:24.721960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:24.722413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:24.723175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:24.723614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:24.852106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:24.859387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f3e30d9e-68b5-4118-a22d-3edf8d46d0fc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148420 May 16 17:03:24.859988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 429/869] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:25.344526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:03:25.345111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:03:25.367023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:25.367933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:25.374860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:25.375305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:25.376067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:25.376501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:25.405347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-90a9aaa7-840e-44c4-805c-9c79184bf73a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042112 May 16 17:03:25.405938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 441/870] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:25.876748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:25.877376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:25.883901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:25.884347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:25.885111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:25.885571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:26.012018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:26.019454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-af969d7c-5a5c-4bc0-872b-117c8406b81e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146540 May 16 17:03:26.020027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 430/871] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:26.416640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:26.417558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:26.424156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:26.424606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:26.425459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:26.425939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:26.454205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5714b945-e3fd-4560-8119-caeb97a531d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041523 May 16 17:03:26.454745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 442/872] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:26.825857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:03:26.826092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:03:27.036382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:27.037045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:27.043298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:27.043750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:27.044523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:27.044963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:27.172572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:27.179908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-41bee73d-f478-4121-9623-8dff667dc211 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147469 May 16 17:03:27.180476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 431/873] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:27.465833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:27.466746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:27.473442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:27.473951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:27.474705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:27.475133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:27.502622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e11fb43f-fd17-4085-bdc0-d21a6ed42d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040786 May 16 17:03:27.503155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 443/874] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:28.196704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:28.197317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:28.203605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:28.204056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:28.204820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:28.205258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:28.333218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:28.340497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e9deba50-8590-496b-a6f6-d1bcf2843a2d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147636 May 16 17:03:28.341054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 432/875] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:28.514927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:28.515800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:28.522605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:28.523051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:28.523817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:28.524279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:28.552440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33733707-0d8d-4f76-8781-c3efd4b06175 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041598 May 16 17:03:28.552978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 444/876] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:29.359590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:29.360203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:29.368467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:29.368929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:29.369720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:29.370180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:29.496858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:29.504199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-62cbf7b6-5f63-44f2-bcc7-3570ad3e1cef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148472 May 16 17:03:29.504772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 433/877] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:29.563861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:29.564764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:29.571541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:29.572161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:29.572936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:29.573479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:29.602471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-24cd1c97-b9ca-43fa-98ce-2ea71e5a0cd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042516 May 16 17:03:29.603013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 445/878] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:30.521764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:30.522323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:30.528634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:30.529088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:30.529895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:30.530338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:30.614081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:30.615003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:30.621311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:30.621785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:30.622561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:30.622996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:30.653663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9a825a61-0b04-48ff-83e7-178628f6561d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043446 May 16 17:03:30.654515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 446/879] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:30.662233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:30.669459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c5a3b76e-7f5a-408c-bfb8-f2e60cb2e9ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152275 May 16 17:03:30.670049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 434/880] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:31.666161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:31.666986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:31.673459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:31.673957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:31.674713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:31.675141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:31.686760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:31.687374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:31.693607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:31.694119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:31.694887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:31.695325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:31.702956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-91f9b17e-9d44-4f13-b359-c7d447f76c0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041548 May 16 17:03:31.703518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 447/881] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:31.821714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:31.829012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b4a28ef5-a0a2-4691-aacd-19d36342a8ff tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146032 May 16 17:03:31.829570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 435/882] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:03:32.714753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:32.715589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:32.722213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:32.722665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:32.723431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:32.723865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:32.752556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7a9e20a1-aa27-4e9e-81f8-54684fa131fc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041821 May 16 17:03:32.753114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 448/883] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:32.846769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:32.847389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:32.854167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:32.854623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:32.855393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:32.855833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:32.980998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:32.988231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-991b8050-3867-4c2e-a2bc-f5a6c38ff77a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145558 May 16 17:03:32.988795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 436/884] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:33.763789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:33.764630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:33.770891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:33.771342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:33.772110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:33.772573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:33.799970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9aea94f9-2248-46e2-94e2-986365416333 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040239 May 16 17:03:33.800523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 449/885] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:34.004335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:34.004942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:34.011833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:34.012275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:34.013032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:34.013460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:34.142589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:34.149921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9bfc75f9-1252-4657-aa9e-7530f33b8846 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149374 May 16 17:03:34.150498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 437/886] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:34.812241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:34.813156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:34.819461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:34.819907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:34.820664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:34.821103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:34.848848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a789b068-ee4b-4a54-886f-4814f7ff6fa8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040607 May 16 17:03:34.849390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 450/887] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:35.166756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:35.167380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:35.173766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:35.174222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:35.174995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:35.175436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:35.300571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:35.308535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-53ae3e14-3f24-4be9-a4f8-6fa701dee1f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145641 May 16 17:03:35.309112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 438/888] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:35.860976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:35.861893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:35.868749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:35.869166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:35.869945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:35.870372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:35.899072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c08920bf-93b6-400a-92cd-b219ccf04708 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042006 May 16 17:03:35.899626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 451/889] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:36.325905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:36.326456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:36.332773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:36.333220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:36.334014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:36.335034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:36.468110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:36.475712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-547e681e-3ebe-42a5-9ca9-d6cc677b2686 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153818 May 16 17:03:36.476284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 439/890] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:36.913314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:36.914258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:36.920377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:36.920826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:36.921582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:36.922047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:36.950317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b360719-b2c4-4e86-8c62-2781d93acde2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041074 May 16 17:03:36.950862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 452/891] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:37.493629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:37.494202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:37.500812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:37.501257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:37.502036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:37.502467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:37.630652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:37.638526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4c8a41ac-611a-47d1-b386-0204bb36f53d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149329 May 16 17:03:37.639185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 440/892] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:37.961792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:37.962705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:37.969178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:37.969630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:37.970420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:37.970859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:38.000226 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-353aa5bd-05b5-4fbb-ba5e-1957f30c768d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042474 May 16 17:03:38.000791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 453/893] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:38.655493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:38.656143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:38.662732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:38.663175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:38.664039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:38.664494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:38.796745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:38.804091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-25993559-794c-4dda-9200-14bf8ac4fae5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152411 May 16 17:03:38.804663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 441/894] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:39.012987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:39.013954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:39.020130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:39.020580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:39.021342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:39.021797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:39.049729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1fa630b5-17d3-4892-ba89-92566e81316f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040762 May 16 17:03:39.050323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 454/895] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:39.821062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:39.821605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:39.827874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:39.828321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:39.829085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:39.829517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:39.954255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:39.962103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-62062917-ea83-4451-a223-7eec74401cf7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144993 May 16 17:03:39.962673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 442/896] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:40.061760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:40.062703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:40.069413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:40.069878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:40.070635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:40.071113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:40.101067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cb74c406-11f5-4cdd-9d9a-84001275ee95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043218 May 16 17:03:40.101635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 455/897] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:40.980199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:40.980843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:40.987288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:40.987682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:40.988450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:40.988917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:41.112499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:41.113419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:41.115345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:41.120316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:41.120761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:41.121591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:41.122053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:41.123532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b3c3398c-6ba1-40cc-aeba-43feb315ddbd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147235 May 16 17:03:41.124183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 443/898] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:41.150872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7e79062f-a43c-4866-a02e-906c5396892b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042273 May 16 17:03:41.151429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 456/899] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:42.139836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:42.140447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:42.147231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:42.147680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:42.148440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:42.148881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:42.161935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:42.163509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:42.169834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:42.170286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:42.171052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:42.171487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:42.200657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-07df1924-11e3-41bc-9e05-ee24975fde79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042705 May 16 17:03:42.201221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 457/900] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:42.280401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:42.288111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5bc269fa-ecc1-4b6e-b503-87285b74b190 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151609 May 16 17:03:42.288683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 444/901] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:43.212410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:43.213337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:43.219917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:43.220368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:43.221131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:43.221589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:43.250797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fb060a48-313c-492a-9fdc-7e17fc58aae0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042405 May 16 17:03:43.251382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 458/902] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:43.305435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:43.306076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:43.312283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:43.312732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:43.313499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:43.313966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:43.440698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:43.448020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1d99da85-8348-4d0c-ad8c-2f356da5e413 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146961 May 16 17:03:43.448589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 445/903] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:44.263182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:44.264091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:44.270447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:44.270898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:44.271682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:44.272115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:44.299522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-efe99af2-d435-450f-8cd2-def3778ecc76 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040401 May 16 17:03:44.300065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 459/904] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:44.465059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:44.465683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:44.472249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:44.472700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:44.473463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:44.473932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:44.601877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:44.609190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3c71d7fc-d71a-48f6-b247-252225437379 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147942 May 16 17:03:44.609771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 446/905] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:45.311737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:45.312658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:45.318667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:45.319116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:45.319881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:45.320319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:45.349023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f338f414-5076-46a3-b43d-7bdc551f07b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041293 May 16 17:03:45.350131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 460/906] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:45.626549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:45.627171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:45.633112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:45.633577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:45.634386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:45.634866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:45.764284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:45.772076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7965a703-52e8-4dc2-9e45-441f2dd5458f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148860 May 16 17:03:45.772640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 447/907] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:46.360961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:46.362543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:46.369391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:46.369876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:46.370641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:46.371075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:46.399159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-abd52bc7-cc72-41ac-a60b-00c91f80ac68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042150 May 16 17:03:46.399724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 461/908] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:46.788329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:46.789005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:46.795500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:46.795961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:46.796733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:46.797171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:46.930180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:46.937390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-50f1e6c3-e852-4a30-a328-48b061db0fb9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152897 May 16 17:03:46.938002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 448/909] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:47.410968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:47.411894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:47.418214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:47.418666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:47.419436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:47.419875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:47.448584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6b7ffe7e-ae17-48ee-a94a-b18da23ced9d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041588 May 16 17:03:47.449147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 462/910] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:47.954859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:47.955465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:47.961805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:47.962251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:47.963009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:47.963465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:48.091252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:48.098736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce09cebd-d1ce-48b8-81d0-6aac02178882 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147687 May 16 17:03:48.099300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 449/911] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:48.459728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:48.460644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:48.467005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:48.467455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:48.468220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:48.468653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:48.497757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6e30ee0b-f999-470c-a2d1-dc47354d4b7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 May 16 17:03:48.498318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 463/912] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:49.117131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:49.117781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:49.123990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:49.124439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:49.125196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:49.125625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:49.249377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:49.256518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b7f5054c-619d-44ab-a743-559c6de25ffa tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144805 May 16 17:03:49.257079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 450/913] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:49.508741 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:49.509687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:49.515966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:49.516415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:49.517170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:49.517605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:49.545985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2d87eb20-9154-4d0e-9b19-a1795b6054e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041211 May 16 17:03:49.546524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 464/914] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:50.273136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:50.273760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:50.280064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:50.280517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:50.281277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:50.281712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:50.410371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:50.417761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fe23703-0c5e-4b23-9b0a-5110ab3fe924 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148472 May 16 17:03:50.418331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 451/915] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:50.557110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:50.557987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:50.564251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:50.564700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:50.565470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:50.565943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:50.594985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fb519b51-4065-4042-925a-589d84d38ce2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042501 May 16 17:03:50.595540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 465/916] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:51.434933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:51.435553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:51.441900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:51.442356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:51.443126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:51.443569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:51.567663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:51.575432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-24b6685b-c0e1-45b2-b425-d0f479452564 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144372 May 16 17:03:51.575997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 452/917] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:51 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:51.605675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:51.606618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:51.612738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:51.613180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:51.613966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:51.614400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:51.650600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce118287-15ff-40ee-a316-8f01593751a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048758 May 16 17:03:51.651163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 466/918] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:52.592460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:52.593150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:52.599696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:52.600137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:52.601533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:52.601991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:52.662735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:52.664279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:52.675214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:52.675580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:52.676354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:52.676795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:52.707025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-23373898-e0ef-4820-9e1b-b0cfb708d299 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048300 May 16 17:03:52.708678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 467/919] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:03:52.771525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:52.779428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eb89f992-f597-410b-83d6-020b4a1c9db0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.190908 May 16 17:03:52.779990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 453/920] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:53.720507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:53.721375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:53.728258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:53.728710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:53.729483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:53.729962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:53.757982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-46dd3ba2-9eaf-43e6-8fd2-3bf1d5f97e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041909 May 16 17:03:53.758552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 468/921] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:53.796193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:53.796805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:53.803003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:53.803448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:53.804818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:53.805248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:54.089079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:54.096708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b94d43e5-caed-4fe8-8388-fd17d9d4c6d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.304316 May 16 17:03:54.097299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 454/922] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:54.769225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:54.770182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:54.777017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:54.777476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:54.778272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:54.778710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:54.806785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-be4f5b59-7b73-4ef6-b621-f6c7205c2ee7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041567 May 16 17:03:54.807347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 469/923] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:55.114158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:55.114792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:55.120980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:55.121428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:55.122218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:55.122646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:55.246849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:55.254056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f909086-4d95-4727-bdae-82f1c8152f1d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.143717 May 16 17:03:55.254606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 455/924] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:55.818479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:55.819304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:55.825598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:55.826067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:55.826818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:55.827244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:55.855610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cbebaeed-4e7e-45a5-916d-35eafc0bb91c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041157 May 16 17:03:55.856151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 470/925] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:56.271651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:56.272915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:56.279192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:56.279636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:56.280395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:56.280823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:56.409560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:56.417674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bdb4d29d-8781-44c5-92eb-7d2a4b6c53c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149838 May 16 17:03:56.418277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 456/926] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:56.867490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:56.868484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:56.874596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:56.875040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:56.875796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:56.876226 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:56.908038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-78715396-a4bf-4a83-80c8-95fa000339c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045125 May 16 17:03:56.908692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 471/927] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:57.435386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:57.436010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:57.442338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:57.442793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:57.443600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:57.444042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:57.569239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:57.576482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-df993287-df95-45cc-8251-aec9c3b363d5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144977 May 16 17:03:57.577037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 457/928] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:03:57.920049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:57.920958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:57.927178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:57.927619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:57.928423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:57.928880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:57.960998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ca989230-f6cb-42bd-9dc5-06c038bd412b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044921 May 16 17:03:57.961554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 472/929] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:58.593444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:58.594348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:58.601231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:58.601680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:58.602479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:58.602917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:58.730432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:58.737577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-52189b4c-7251-4284-a19e-2eecbbd76586 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148033 May 16 17:03:58.738176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 458/930] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:03:58.972819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:58.973774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:58.980087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:58.980533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:58.981294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:58.981732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:59.009647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a5c9fae8-3037-4e87-accb-9f6918c5cfeb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041108 May 16 17:03:59.010231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 473/931] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:03:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:03:59.754643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:03:59.755187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:03:59.761345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:59.761817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:59.762581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:03:59.763015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:03:59.886935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:03:59.894234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f0beb78-d041-457f-950a-9476c4b9308f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.143564 May 16 17:03:59.894792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 459/932] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:03:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:00.021169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:00.022035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:00.029725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:00.030519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:00.031879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:00.032644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:00.061426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41193401-6469-40f0-bcc5-edde81702068 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 May 16 17:04:00.062024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 474/933] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:00.912285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:00.912905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:00.919744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:00.920191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:00.920959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:00.921394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:01.047184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:01.054447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-03453c90-2488-464c-860d-43b42b318763 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146083 May 16 17:04:01.055004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 460/934] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:01.073046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:01.074126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:01.080311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:01.080769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:01.081551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:01.082029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:01.110776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-45f5aca1-eef0-429f-a4c5-dd1609a81279 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042151 May 16 17:04:01.111336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 475/935] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:02.071989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:02.072605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:02.078837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:02.079284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:02.080048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:02.080479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:02.122973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:02.123885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:02.130175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:02.130623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:02.131391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:02.132517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:02.160723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8ac6bbd1-b9d1-429a-b005-40c0640b3535 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041709 May 16 17:04:02.161302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 476/936] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:02.210170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:02.217517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f40c9cd2-ce2c-42a3-9005-29bbd9d9c326 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149874 May 16 17:04:02.218117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 461/937] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:03.172193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:03.173108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:03.179896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:03.180343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:03.181104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:03.181540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:03.210355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f65634dd-6e80-42ef-a432-efd987b8af47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042189 May 16 17:04:03.210918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 477/938] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:03.234607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:03.235230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:03.242509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:03.242989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:03.243762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:03.244205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:03.379076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:03.390819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-45c8abce-5a68-4d66-8922-cda6d3912745 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.160031 May 16 17:04:03.391389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 462/939] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:04.222283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:04.223201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:04.229459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:04.229948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:04.230714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:04.231150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:04.259263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e6c66a02-4d74-4350-8cc8-5176b17b47c2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041259 May 16 17:04:04.259818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 478/940] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:04.407107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:04.408345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:04.414677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:04.415127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:04.415894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:04.416327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:04.547412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:04.555162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-58a41b7c-a507-4202-a5a0-ffd3924610d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152057 May 16 17:04:04.555722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 463/941] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:05.270825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:05.271742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:05.278105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:05.278540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:05.279313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:05.280116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:05.310197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5f9af0de-f32a-4f16-b146-bdcab863d880 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043229 May 16 17:04:05.310766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 479/942] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:05.572172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:05.572726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:05.579070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:05.579520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:05.580288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:05.580725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:05.707404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:05.714802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-97ee84d5-a4ce-4999-a30d-618fb1029b92 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146642 May 16 17:04:05.715377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 464/943] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:06.322161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:06.323000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:06.329245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:06.329713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:06.330507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:06.330944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:06.359139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-99bbd2d3-cf82-4b77-9f98-8656e46cb796 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041174 May 16 17:04:06.359687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 480/944] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:06.731700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:06.732337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:06.738624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:06.739080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:06.739843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:06.740272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:06.869434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:06.876884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7a5786de-6385-4796-9b41-0cc9f0838c09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149046 May 16 17:04:06.877455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 465/945] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:07.371364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:07.372287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:07.378500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:07.378952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:07.379714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:07.380152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:07.409437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fa044171-35d7-4d06-83d1-63ccf984e7f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 May 16 17:04:07.410271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 481/946] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:07.893146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:07.893783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:07.900658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:07.901113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:07.901926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:07.902387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:08.031025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:08.038270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e9493c18-1586-4889-a4d0-2dde50f2e0ba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149032 May 16 17:04:08.038831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 466/947] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:08.420604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:08.421527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:08.427856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:08.428815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:08.429576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:08.430073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:08.458476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3ac50b10-661d-4f22-a525-62d48b8c4823 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041829 May 16 17:04:08.459039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 482/948] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:09.055630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:09.056167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:09.062575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:09.063033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:09.063803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:09.064245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:09.186932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:09.200301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fb14b956-e865-4f42-a2a3-3ee2742f24e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149011 May 16 17:04:09.200890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 467/949] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:09.469660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:09.470599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:09.477374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:09.477843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:09.478597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:09.479027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:09.506779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f56f5944-baa7-42e7-aaa3-225fe00a4264 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041340 May 16 17:04:09.507323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 483/950] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:10.217378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:10.218021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:10.224535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:10.224988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:10.225776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:10.226217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:10.353613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:10.360897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-035980e4-5dd2-4c1b-a5d2-c965ceafb898 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147429 May 16 17:04:10.361465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 468/951] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:10.517925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:10.518807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:10.525019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:10.525466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:10.526264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:10.526701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:10.554528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-412b4a0f-09eb-48a3-b7b1-7b54735de0ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040700 May 16 17:04:10.555087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 484/952] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:11.378507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:11.379105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:11.386024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:11.386482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:11.387250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:11.387685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:11.512497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:11.519757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1b51958f-ba75-4e1b-a902-27b9c95085e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145082 May 16 17:04:11.520311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 469/953] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:11.565355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:11.566300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:11.572955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:11.573403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:11.574201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:11.574638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:11.602796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1e71c373-8447-4cef-aeb6-1b45e9c6d1c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041453 May 16 17:04:11.603340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 485/954] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:12.537157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:12.538310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:12.544568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:12.545022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:12.545807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:12.546250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:12.614521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:12.615437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:12.622282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:12.622729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:12.623495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:12.623929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:12.653307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f47793e3-14d9-4333-adb0-b265f6b699d0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042705 May 16 17:04:12.653910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 486/955] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:12.676381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:12.683720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b99d1c0e-840f-430c-98f0-6e9c85ea5a6a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150465 May 16 17:04:12.684280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 470/956] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:13.664875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:13.665704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:13.672022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:13.672470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:13.673230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:13.673663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:13.700849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:13.701454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:13.702415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b51dd9f3-da03-4f2e-9d9f-d17d6c95b048 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041646 May 16 17:04:13.703097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 487/957] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:13.707792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:13.708239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:13.709008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:13.709477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:13.833701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:13.841498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1a90a145-808c-4656-b21b-15c57a0ed378 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144433 May 16 17:04:13.842087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 471/958] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:04:14.714098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:14.714922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:14.721077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:14.721517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:14.722290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:14.722717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:14.750953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4e8f8705-b302-4307-9d84-73586030f0d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040924 May 16 17:04:14.751485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 488/959] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:14.858491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:14.859111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:14.865279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:14.866347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:14.867106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:14.867540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:14.992023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:14.999255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5a828dad-265b-44bd-af11-569657103cdd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144545 May 16 17:04:14.999827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 472/960] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:15.762752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:15.763574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:15.769798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:15.770249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:15.771009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:15.771446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:15.799478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-48403d60-6504-4b0a-a451-801733ea9637 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040807 May 16 17:04:15.800045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 489/961] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:16.016698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:16.017275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:16.023694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:16.024141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:16.024910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:16.025372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:16.156247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:16.164291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-32276af1-2cea-4136-8e99-0dddefc8d48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151532 May 16 17:04:16.164870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 473/962] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:16.812134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:16.813047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:16.819789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:16.820236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:16.820995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:16.821428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:16.849477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4492f1fc-3a74-4538-9a32-81c96b6ea9b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041525 May 16 17:04:16.850056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 490/963] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:17.180350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:17.180958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:17.187170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:17.187613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:17.188369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:17.188796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:17.311719 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:17.318979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fe1a0b55-21d2-4f24-a3b0-2917d18ce1c6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.142510 May 16 17:04:17.319549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 474/964] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:17.860580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:17.861496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:17.868330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:17.868776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:17.869532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:17.869991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:17.897905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cfa37c27-cf76-4988-9143-937353a2ea19 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041301 May 16 17:04:17.898461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 491/965] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:18.337491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:18.338141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:18.344617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:18.345062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:18.345859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:18.346300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:18.475190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:18.482376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2ff8b9f5-57dc-4152-97f0-1c017b20a48a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149895 May 16 17:04:18.482944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 475/966] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:18.909502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:18.910461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:18.916655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:18.917099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:18.917877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:18.918313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:18.947758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e38ff5ce-287e-4f62-b078-4ac50cb07ee0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042136 May 16 17:04:18.948324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 492/967] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:19.499217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:19.499832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:19.506800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:19.507252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:19.508015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:19.508449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:19.632882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:19.640326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f6e452b6-e1ec-4777-9db0-f221479490e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144983 May 16 17:04:19.640910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 476/968] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:19.959519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:19.960463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:19.967445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:19.967445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:19.968023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:19.968719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:19.998143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f8889f02-5c77-4890-a315-a124a537fa20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042693 May 16 17:04:19.998699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 493/969] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:20.657964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:20.658697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:20.665118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:20.665514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:20.666311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:20.666749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:20.794495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:20.801776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f1c267ff-8392-4f1f-8927-1c5a965ce7bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147827 May 16 17:04:20.802370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 477/970] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:21.010703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:21.011548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:21.017684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:21.018155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:21.018904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:21.019332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:21.046597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9cbbd305-1499-4891-b5d6-453cb95f5921 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040688 May 16 17:04:21.047140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 494/971] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:21.819632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:21.820177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:21.826540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:21.827002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:21.827778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:21.828220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:21.956963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:21.964331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8844c2d4-4748-4a0e-be1b-d4b9be7646a7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149346 May 16 17:04:21.964906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 478/972] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:22.058848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:22.059754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:22.065961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:22.066407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:22.067188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:22.067599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:22.095353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9c5aa5fb-8750-4e0e-915e-77127b96b4ae tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040622 May 16 17:04:22.095899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 495/973] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:22.981589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:22.982234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:22.988560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:22.989016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:22.989882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:22.990331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:23.107346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:23.108295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:23.114475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:23.114877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:23.116318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:23.116755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:23.117544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:23.124944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f9ea3f86-6ca7-4300-84a1-fe01cae0d8cf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147289 May 16 17:04:23.125516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 479/974] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:23.144997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bec27f70-2822-42cf-a901-b0c6b5699f3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041577 May 16 17:04:23.145551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 496/975] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:24.141958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:24.142576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:24.148935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:24.149388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:24.150183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:24.150626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:24.156828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:24.157832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:24.163943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:24.164379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:24.165135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:24.165558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:24.194787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-063ea7c1-34cc-409c-a497-d19252e30e88 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041834 May 16 17:04:24.195555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 497/976] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:24.278315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:24.285649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a0db181c-6d8f-4e75-8b76-2ce3573c8b7e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147547 May 16 17:04:24.286240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 480/977] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:25.206453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:25.207360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:25.214145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:25.214585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:25.215330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:25.215763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:25.243336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e8f2de22-926a-490a-9ee1-a8296e9b7cd0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040865 May 16 17:04:25.243872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 498/978] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:25.305129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:25.305720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:25.312152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:25.312599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:25.313390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:25.313849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:25.441637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:25.449523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ea5237e6-7e71-4c79-9bd0-738ddcccaa73 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148347 May 16 17:04:25.450130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 481/979] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:26.254981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:26.255885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:26.262116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:26.262559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:26.263324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:26.263753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:26.292506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bd703f82-8eb5-4947-9351-8caa7247d017 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041433 May 16 17:04:26.293057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 499/980] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:26.466625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:26.467245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:26.473844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:26.474297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:26.475067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:26.476025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:26.603200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:26.610590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ef5fc353-5be1-4c72-9b28-4f15828f34b8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147917 May 16 17:04:26.611166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 482/981] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:27.304343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:27.305246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:27.311440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:27.311883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:27.312634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:27.313063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:27.341278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9f7e6e8e-ceef-44e3-aeb8-90e6471b254c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041162 May 16 17:04:27.341836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 500/982] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:27.628325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:27.628965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:27.635920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:27.636373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:27.637139 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:27.637574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:27.761320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:27.768626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2b330a1c-9b59-4ea0-bcaf-fbd70afb158a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144200 May 16 17:04:27.769189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 483/983] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:28.352707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:28.353611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:28.359899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:28.360346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:28.361107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:28.361539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:28.391094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c3d2bc9e-a3c8-4294-afde-dd2cb98b9eb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042370 May 16 17:04:28.391665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 501/984] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:28.784862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:28.785482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:28.792300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:28.792753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:28.793522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:28.793995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:28.921719 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:28.929581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7a1b2fb4-408b-460f-a39d-67bb49c9efae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148044 May 16 17:04:28.930181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 484/985] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:29.403223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:29.404133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:29.410779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:29.411233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:29.411985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:29.412779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:29.441380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f75a28c-7928-45f5-bf88-bbd41037509f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042112 May 16 17:04:29.441967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 502/986] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:29.946534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:29.947152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:29.953426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:29.953914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:29.954683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:29.955117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:30.081534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:30.089317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d73303ac-73f9-4a00-a639-ef7b163bacf8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146641 May 16 17:04:30.089917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 485/987] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:30.453699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:30.454634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:30.460847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:30.461295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:30.462085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:30.462527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:30.492568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cc95fde5-be1b-44bf-9f59-80459272ce13 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042812 May 16 17:04:30.493047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 503/988] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:31.106547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:31.107168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:31.113496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:31.113995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:31.114766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:31.115202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:31.240658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:31.248384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b47ab0dc-71ce-4e46-b1b7-b29aecc08a91 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145717 May 16 17:04:31.248952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 486/989] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:31.504257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:31.505189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:31.512024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:31.512462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:31.513231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:31.513638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:31.541553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0ccdd4b4-b5d7-4f94-b934-39480dbc2bfe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041357 May 16 17:04:31.542137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 504/990] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:32.265833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:32.266446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:32.272998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:32.273449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:32.274250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:32.274686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:32.402356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:32.409752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12a973f1-7d0e-4a45-9eb6-a8ccc3c647e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147725 May 16 17:04:32.410341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 487/991] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:32.552600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:32.553451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:32.560406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:32.560857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:32.561623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:32.562115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:32.589498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c3a6a8cf-bf3f-4472-a6dd-8818b049f9f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040952 May 16 17:04:32.590076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 505/992] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:33.427240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:33.427846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:33.434249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:33.434694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:33.435450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:33.435880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:33.561601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:33.568961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e4f45579-cf9b-4219-a821-00ab29fac079 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145561 May 16 17:04:33.569533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 488/993] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:33.601301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:33.602244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:33.608494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:33.608946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:33.609708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:33.610171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:33.638701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-19c55b34-0d12-43a9-9768-ab2714ca3fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041312 May 16 17:04:33.639249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 506/994] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:34.586407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:34.587013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:34.594202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:34.594665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:34.595436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:34.595877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:34.650442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:34.651945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:34.658371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:34.658823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:34.659604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:34.660047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:34.688566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7804c3d0-955a-43b1-b3b3-ec7efa4b2efa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042086 May 16 17:04:34.689149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 507/995] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:34.726802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:34.734518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f6c5639-4857-4f4c-a976-5c852de97f28 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151990 May 16 17:04:34.735081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 489/996] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:35.699753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:35.700588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:35.706919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:35.707375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:35.708173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:35.708609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:35.737236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-65ca3c1e-9428-4e9a-a29b-1a0d7fdde986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041630 May 16 17:04:35.737816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 508/997] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:35.751397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:35.752010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:35.758300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:35.758749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:35.759504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:35.759937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:35.885216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:35.892441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8491508b-e231-4cce-9fb3-9b3058a35907 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144875 May 16 17:04:35.893015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 490/998] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:36.749130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:36.750131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:36.756309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:36.756750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:36.757531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:36.757989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:36.786597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4dadebfb-05a5-4dcd-bb9f-c156becfa958 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042041 May 16 17:04:36.787152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 509/999] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:36.910542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:36.911157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:36.917877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:36.918326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:36.919088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:36.919524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:37.049827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:37.057049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0e16a3a6-e116-42a3-8491-bb7a2057da12 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150415 May 16 17:04:37.057609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 491/1000] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:37.797611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:37.798469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:37.804736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:37.805184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:37.806000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:37.806433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:37.834411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b995897-e254-4436-aaee-4b97de9d4cf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040850 May 16 17:04:37.834966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 510/1001] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:38.074666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:38.075208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:38.081439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:38.081921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:38.082688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:38.083120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:38.213108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:38.220547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-df49f916-f508-43ca-8242-e353638e82e8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150577 May 16 17:04:38.221109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 492/1002] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:38.846430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:38.847333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:38.853491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:38.854567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:38.855322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:38.855749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:38.882823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-47853ed9-d465-4b07-927d-2bc748858523 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040659 May 16 17:04:38.883363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 511/1003] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:39.237555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:39.238195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:39.244446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:39.244896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:39.245651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:39.246172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:39.370017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:39.377228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1393fa1b-03c9-4bde-acc8-9f78d240ce9c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.143601 May 16 17:04:39.377807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 493/1004] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:39.894506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:39.895428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:39.902379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:39.902833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:39.903634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:39.904080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:39.932304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4cd7a753-d764-483c-957c-167c5512e5be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041709 May 16 17:04:39.933077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 512/1005] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:40.397770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:40.398391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:40.407557 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:40.408008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:40.408791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:40.409229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:40.540773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:40.548080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8a3452fa-21ee-4e90-8b91-14fa6f8cb9c2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.155885 May 16 17:04:40.548642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 494/1006] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:40.943423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:40.944356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:40.951056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:40.951501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:40.952253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:40.952682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:40.981462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b0c98e25-b6b8-4a82-919c-34fab48ecd20 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042007 May 16 17:04:40.982045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 513/1007] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:41.565513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:41.566157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:41.572389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:41.572836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:41.573590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:41.574053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:41.698669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:41.705907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a4d6cd95-5fb5-4636-bc45-7fced98f22c9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144236 May 16 17:04:41.706465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 495/1008] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:41.992935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:41.993797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:41.999923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:42.000370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:42.001132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:42.001567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:42.029998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5968b191-25d1-4dec-9697-758d5fe1d34e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041097 May 16 17:04:42.030554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 514/1009] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:42.723564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:42.724112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:42.730673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:42.731126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:42.731967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:42.732403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:42.856995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:42.864265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4b6fefb5-3dd4-4b3b-8568-6ced8caf89f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144686 May 16 17:04:42.864838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 496/1010] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:43.041980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:43.042823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:43.048997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:43.049445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:43.050231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:43.050666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:43.078604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-94b16526-8c6d-421e-8a6b-62694c1c4436 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041185 May 16 17:04:43.079156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 515/1011] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:43.881609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:43.882250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:43.888614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:43.889058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:43.889846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:43.890279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:44.017945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:44.025149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-945ec1f7-e3f0-42f0-a65d-3890381a7ab2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147370 May 16 17:04:44.026311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 497/1012] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:44.090815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:44.091718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:44.098176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:44.098621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:44.099368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:44.099793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:44.128484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cda49ea4-f76e-44a8-87b5-62ae4faa3dc4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042351 May 16 17:04:44.129046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 516/1013] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:45.043590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:45.044134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:45.050130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:45.050582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:45.051353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:45.051794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:45.140973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:45.141947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:45.147873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:45.148349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:45.149119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:45.149553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:45.178194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-676ee917-bb97-462b-9582-086c44c919db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041052 May 16 17:04:45.178778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 517/1014] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:45.182003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:45.189231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-02036e88-63f0-442d-8984-4597149f27d8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150246 May 16 17:04:45.189801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 498/1015] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:46.189918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:46.190829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:46.197626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:46.198105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:46.198865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:46.199298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:46.206592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:46.207205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:46.214010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:46.214459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:46.215222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:46.215651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:46.228758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b7b223a2-fe77-4668-9486-9f1428c83942 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042819 May 16 17:04:46.229337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 518/1016] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:46.348418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:46.355674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-639f1f70-a55b-45f2-a684-cd89b26ee59b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153052 May 16 17:04:46.356233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 499/1017] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:04:47.240687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:47.241596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:47.247924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:47.248375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:47.249137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:47.249575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:47.277187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d2304e57-abde-49f6-b054-2ba62282a3d8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040548 May 16 17:04:47.277726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 519/1018] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:47.372477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:47.373089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:47.379490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:47.379940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:47.380701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:47.381136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:47.505397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:47.513133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0665cf5e-960c-45db-9662-500e65e590dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144518 May 16 17:04:47.513700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 500/1019] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:48.288629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:48.289542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:48.296300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:48.296749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:48.297514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:48.297982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:48.326171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-df360435-24a4-4511-849b-23b2b0a64b7a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041556 May 16 17:04:48.326720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 520/1020] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:48.530563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:48.531202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:48.537514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:48.538004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:48.538817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:48.539247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:48.667093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:48.674379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c6c4b317-8cbc-43f0-a7da-482402e21718 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147693 May 16 17:04:48.674954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 501/1021] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:49.338362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:49.339297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:49.345792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:49.346242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:49.346995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:49.347424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:49.375858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-05fda753-6729-4c3b-ac2b-5d551c3a65e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041901 May 16 17:04:49.376416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 521/1022] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:49.691589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:49.692116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:49.698980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:49.699441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:49.700215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:49.700657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:49.827965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:49.835302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f119a45b-dcf3-4c69-aa02-33c97f93305a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147687 May 16 17:04:49.835868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 502/1023] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:50.390385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:50.391290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:50.397656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:50.398141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:50.398907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:50.399340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:50.428450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f334e1e9-7331-4fb6-be8d-e8720678921d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041998 May 16 17:04:50.429041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 522/1024] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:50.853940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:50.854582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:50.861608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:50.862088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:50.862861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:50.863296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:50.987881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:50.995234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9c9ebb16-a215-4fee-a59e-7cf312b1ac77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145803 May 16 17:04:50.995797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 503/1025] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:51.440135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:51.441035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:51.447764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:51.448223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:51.448978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:51.449404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:51.477422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c47ba6d9-755e-44f1-a303-c38329436824 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041278 May 16 17:04:51.478003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 523/1026] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:52.012073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:52.012677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:52.018948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:52.019394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:52.020157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:52.020588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:52.150823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:52.158053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-103a5c84-25b9-45cf-94e7-29bc292160e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149813 May 16 17:04:52.158622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 504/1027] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:52.489059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:52.489996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:52.496844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:52.497291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:52.498084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:52.498520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:52.526849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4d838316-ad76-4461-a3ad-f675a9939b4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041701 May 16 17:04:52.527417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 524/1028] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:53.180430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:53.181045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:53.187338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:53.187783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:53.188541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:53.188972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:53.314170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:53.321349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-71ec38bb-baa0-443d-9b2a-d06a24c8379d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144823 May 16 17:04:53.321971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 505/1029] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:53.538734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:53.539577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:53.545730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:53.546199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:53.546955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:53.547382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:53.576128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-abdbdefb-d342-4073-9c22-212254877156 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041466 May 16 17:04:53.576675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 525/1030] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:54.338432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:54.339126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:54.345714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:54.346211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:54.346977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:54.347412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:54.482226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:54.489514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f27ff8e5-bd20-4ae5-9cde-89ddc8fd2780 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154947 May 16 17:04:54.490123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 506/1031] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:54.588193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:54.589145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:54.595644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:54.596095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:54.596876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:54.597310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:54.625699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b74ba6d2-a952-44ed-9053-65c71668b8a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041943 May 16 17:04:54.626275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 526/1032] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:55.507214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:55.507820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:55.514614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:55.515064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:55.515852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:55.516313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:55.637345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:55.638388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:55.643768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:55.644922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:55.645364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:55.646146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:55.646576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:55.651314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b5e33936-edbc-488b-9212-9504d3e12b6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147974 May 16 17:04:55.651880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 507/1033] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:55.675057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a9bd65ad-054c-40cc-829b-fcc4e4973bef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042408 May 16 17:04:55.675530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 527/1034] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:56.668639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:56.669161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:56.675483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:56.675943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:56.676716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:56.677157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:56.685878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:56.686711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:56.693679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:56.694159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:56.694934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:56.695375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:56.730380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6a44c80d-c562-41bb-a38e-fc0992b2c881 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048408 May 16 17:04:56.734374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 528/1035] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:56.806759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:56.814577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-385f1c8b-1a72-4276-84e0-c2b5acf28908 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149936 May 16 17:04:56.815139 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 508/1036] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:57.741490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:57.742475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:57.749288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:57.749757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:57.750518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:57.750954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:57.779551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61ee3c1c-5395-4b6b-a847-66f8e612fbaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 May 16 17:04:57.780112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 529/1037] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:04:57.831893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:57.832518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:57.838827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:57.839285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:57.840062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:57.840506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:57.967332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:57.974923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3df9a72f-383f-44ce-a054-376bb7b87d32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146879 May 16 17:04:57.975486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 509/1038] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:58.791204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:58.792270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:58.798713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:58.799153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:58.799908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:58.800342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:58.828155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-10440327-8bd2-48f3-a58b-fef1eab506ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040885 May 16 17:04:58.828635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 530/1039] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:04:58.992285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:58.992898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:58.999676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:59.000126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:59.000892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:59.001327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:59.125927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:04:59.133178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fd0f70c-19a1-41ed-96e2-2f6b0c741533 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144853 May 16 17:04:59.133795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 510/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:04:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:04:59.839789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:04:59.840733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:04:59.847187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:59.847635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:59.848394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:04:59.848828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:04:59.876816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-db72c917-c858-45ad-95f0-27c3535f62a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041050 May 16 17:04:59.877364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 531/1041] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:04:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:00.150694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:00.151239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:00.157491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:00.157974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:00.158734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:00.159164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:00.300031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:00.308444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-690d2a22-77f7-406d-8050-7a4aac516b6e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.161538 May 16 17:05:00.309440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 511/1042] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:00.888275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:00.889187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:00.895447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:00.895893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:00.896654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:00.897085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:00.925126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-adb16416-2eac-4205-a6cc-ea5991934d64 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041445 May 16 17:05:00.925671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 532/1043] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:01.326230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:01.326845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:01.333108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:01.333549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:01.334361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:01.334790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:01.464430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:01.472015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0baa358c-30e8-4ace-bd59-0aef81eae60d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150170 May 16 17:05:01.472590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 512/1044] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:01.936233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:01.937051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:01.943359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:01.943803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:01.944557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:01.944989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:01.973755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-045d6774-ce09-43f5-b535-af7add40b39d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041620 May 16 17:05:01.974309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 533/1045] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:02.489589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:02.490233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:02.497071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:02.497526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:02.498319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:02.498761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:02.624954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:02.632095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2dd03bef-01d2-4aab-a6c7-8ced090629b4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146379 May 16 17:05:02.632662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 513/1046] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:02.985495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:02.986344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:02.992662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:02.993107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:02.994411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:02.994840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:03.023522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0eb945a0-c2a8-402f-a31b-409bf09190b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042090 May 16 17:05:03.024074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 534/1047] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:03.649052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:03.650188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:03.656492 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:03.656946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:03.657712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:03.658178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:03.785089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:03.792988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-91e8af28-6039-49a5-beee-de0095f789dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147826 May 16 17:05:03.793560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 514/1048] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:04.035165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:04.036063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:04.042872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:04.043323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:04.044096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:04.044534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:04.072982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9757e2c2-0e82-4a01-ac15-7968fc6d3ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041892 May 16 17:05:04.073539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 535/1049] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:04.810331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:04.810944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:04.817220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:04.817671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:04.818469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:04.818913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:04.943626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:04.951361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-063703e3-a97a-4add-972f-bc5a0ac0106a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145245 May 16 17:05:04.951927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 515/1050] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:05.084941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:05.085886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:05.092533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:05.093031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:05.093955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:05.094398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:05.123445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5766be56-c31c-4e9e-b69f-6d7b09c1adcb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042514 May 16 17:05:05.123985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 536/1051] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:05.969032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:05.969676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:05.975933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:05.976377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:05.977134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:05.977567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:06.135981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:06.137002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:06.144127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:06.144601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:06.145382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:06.145838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:06.177189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d8ba62f0-3304-433b-aab2-96fe3b370d1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045925 May 16 17:05:06.178065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 537/1052] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:06.346085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:06.353616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c704df0a-cfff-4a63-96fa-a8e82209e129 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.388725 May 16 17:05:06.354211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 516/1053] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:05:07.189357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:07.190291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:07.196494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:07.197005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:07.197794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:07.198210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:07.225954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b273400-aa5f-4648-9e34-24b613024dbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040536 May 16 17:05:07.226496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 538/1054] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:07.370483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:07.371094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:07.377297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:07.377762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:07.378532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:07.378964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:07.503604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:07.510802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2c264f61-18a8-4441-8a55-2ce3972f2cb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144185 May 16 17:05:07.511368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 517/1055] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:08.237513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:08.238448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:08.245245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:08.245686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:08.246465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:08.246897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:08.274859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ec9af60f-7932-4bf6-9093-0975365fff49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041303 May 16 17:05:08.275396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 539/1056] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:08.527824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:08.528351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:08.534799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:08.535259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:08.536040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:08.536483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:08.662924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:08.670696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f84a3d2-f08d-44da-a304-ec57b383373d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146848 May 16 17:05:08.671271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 518/1057] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:09.286229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:09.287148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:09.293439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:09.293995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:09.294765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:09.295201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:09.323144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a2ec040c-4edb-45ca-8ab7-e79f7fb82884 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040980 May 16 17:05:09.323689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 540/1058] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:09.687508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:09.688153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:09.694450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:09.694897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:09.695655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:09.696081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:09.824207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:09.831490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b436ce8b-ea05-456f-bd3d-45c82d2a7369 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147822 May 16 17:05:09.832058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 519/1059] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:10.334736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:10.335649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:10.342686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:10.343131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:10.343894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:10.344327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:10.372266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9c49aae7-700d-4838-a77f-4a2fee81ebff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041481 May 16 17:05:10.372806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 541/1060] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:10.848839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:10.849445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:10.857267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:10.858023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:10.859048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:10.859556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:10.989125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:10.996934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-20e4c0c8-32ba-4671-adaf-2ee646e277ce tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151905 May 16 17:05:10.997508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 520/1061] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:11.384919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:11.385851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:11.392089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:11.392532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:11.393289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:11.393715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:11.422881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6b69a9c1-1317-4f0a-8cbe-424986db6905 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042675 May 16 17:05:11.423437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 542/1062] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:12.014385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:12.015003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:12.021486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:12.021972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:12.022770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:12.023200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:12.147307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:12.154559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-23dc11ca-cc13-457b-b3f6-7dda3dfca3cc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144070 May 16 17:05:12.155114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 521/1063] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:12.434650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:12.435565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:12.442674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:12.443105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:12.443866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:12.444293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:12.472477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a1e4dddc-f554-43e5-9f3d-4728f58d2ba0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041903 May 16 17:05:12.473031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 543/1064] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:13.171436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:13.172048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:13.178302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:13.178752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:13.179509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:13.179941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:13.304488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:13.312149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-05da9275-c89e-4192-b0a7-8064947bf98d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144600 May 16 17:05:13.312714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 522/1065] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:13.484081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:13.484926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:13.491174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:13.491618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:13.492369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:13.492803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:13.521381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c410b2a7-647e-448d-8ca5-8e316845cfb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041317 May 16 17:05:13.521962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 544/1066] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:14.329871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:14.330487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:14.337301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:14.337777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:14.338550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:14.338991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:14.472777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:14.480087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8eb8747c-2622-4dbe-aad9-0fa4669a9869 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154178 May 16 17:05:14.480661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 523/1067] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:14.532958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:14.533931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:14.539679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:14.540130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:14.540896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:14.541337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:14.568775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-359356f9-6862-489b-9d5e-78174f0f9338 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039914 May 16 17:05:14.569324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 545/1068] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:15.497095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:15.497713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:15.503906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:15.504355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:15.505127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:15.505554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:15.580648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:15.581722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:15.588298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:15.589007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:15.589803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:15.590239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:15.622651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-45e503e1-d5f8-4562-8ff0-1e2e5ccecd75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045953 May 16 17:05:15.623218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 546/1069] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:15.635559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:15.643401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d20fcac7-78d9-4ce2-875e-7f499107f798 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150911 May 16 17:05:15.644000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 524/1070] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:16.208463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:05:16.208686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:05:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:05:16.634898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:16.635824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:16.642102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:16.642554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:16.643318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:16.643753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:16.660172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:16.660789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:16.666978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:16.667444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:16.668204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:16.668641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:16.673301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3239c654-8f9e-4a88-998e-923d292a4b50 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042856 May 16 17:05:16.673886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 547/1071] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:16.801503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:16.809363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dbb8b155-05b5-45cc-88c7-5eb5f1d50722 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152863 May 16 17:05:16.810064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 525/1072] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:05:17.684981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:17.685828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:17.692034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:17.692479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:17.693237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:17.693671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:17.724516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f925bca-0228-41e1-a946-fba3f9837d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043582 May 16 17:05:17.725062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 548/1073] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:17.827521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:17.828141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:17.834452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:17.834906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:17.835679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:17.836120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:17.962477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:17.969941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f5781ed-0bc3-4480-a4b5-e1e493d231f0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146422 May 16 17:05:17.970513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 526/1074] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:18.736409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:18.737230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:18.743612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:18.744171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:18.744935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:18.745373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:18.773280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7e1698e-b9fe-4c37-ac02-d1411914de4c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040925 May 16 17:05:18.773851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 549/1075] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:18.986753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:18.987309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:18.993621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:18.994112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:18.994880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:18.995327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:19.121296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:19.128682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e6a8a7dd-0de9-4369-bfa5-ab8e6675b6d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145808 May 16 17:05:19.129254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 527/1076] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:19.785297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:19.786210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:19.793048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:19.793499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:19.794306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:19.794750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:19.823079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2fedbd4b-f2fd-4912-a0f8-889d445883e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041885 May 16 17:05:19.823640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 550/1077] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:20.145831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:20.146446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:20.153224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:20.153668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:20.154454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:20.154889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:20.285368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:20.293241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-44f0c2d7-f49e-4b44-962e-ad6825e08c76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151323 May 16 17:05:20.293820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 528/1078] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:20.833873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:20.834781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:20.841488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:20.842212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:20.842974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:20.843406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:20.873033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce0a6601-01ed-4147-a960-2834239e8413 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 May 16 17:05:20.873601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 551/1079] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:21.309779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:21.310413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:21.316679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:21.317127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:21.317914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:21.318350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:21.450778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:21.458094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5317cc91-47f6-4d9c-b82d-63edf15aad75 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152129 May 16 17:05:21.458661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 529/1080] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:21.885313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:21.886272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:21.892510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:21.892956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:21.893715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:21.894184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:21.921941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9e262115-e736-45c0-b71c-3fba86096fc6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041183 May 16 17:05:21.922480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 552/1081] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:22.435458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:05:22.435649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:05:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:05:22.475802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:22.476410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:22.486684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:22.487132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:22.487896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:22.488331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:22.616079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:22.623834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c786c7da-2400-4e93-a8bc-47db2582293d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151894 May 16 17:05:22.624451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 530/1082] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:22.932964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:22.933901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:22.940152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:22.940628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:22.941414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:22.941874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:22.971042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8af5a196-9c74-44f3-875b-a1cbe216e414 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042046 May 16 17:05:22.971581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 553/1083] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:23.640764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:23.641373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:23.647689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:23.648134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:23.648896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:23.649326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:23.779162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:23.786436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-370beabe-db63-4680-8dc6-5335b93d7f7a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149588 May 16 17:05:23.787015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 531/1084] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:23.982660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:23.983532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:23.989788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:23.990237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:23.990993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:23.991421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:24.019723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-98eeb205-1653-4218-a064-d45b8dde0441 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041080 May 16 17:05:24.020255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 554/1085] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:24.803927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:24.804541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:24.812661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:24.813111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:24.813915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:24.814343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:24.949703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:24.956909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4219a4af-bd8b-4954-b1e8-0fd26ae89158 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.156821 May 16 17:05:24.957480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 532/1086] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:25.031089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:25.031998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:25.039427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:25.040080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:25.040842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:25.041290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:25.068976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8e1775d5-cb79-4dc2-b21d-8eb47a93a569 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041748 May 16 17:05:25.069462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 555/1087] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:25.973888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:25.974510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:25.980810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:25.981264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:25.982068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:25.982508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:26.080596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:26.081505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:26.087844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:26.088292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:26.089065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:26.089498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:26.116381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:26.119281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e9dea8bf-f9e3-424d-be82-12ffa670bfa1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042670 May 16 17:05:26.120073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 556/1088] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:26.124623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb4857ce-abc8-4b4d-97fa-d2a408bb1fa9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154544 May 16 17:05:26.125193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 533/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:27.130994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:27.131911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:27.138956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:27.139406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:27.140170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:27.140602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:27.141977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:27.142601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:27.148788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:27.149245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:27.150041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:27.150484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:27.169111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f86065ed-861a-40bf-8f0c-9a0b1d5656be tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042044 May 16 17:05:27.169676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 557/1090] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:27.277281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:27.284571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-53c772ad-17d3-43c1-ae25-20cf23aa458e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146447 May 16 17:05:27.285135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 534/1091] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:05:28.181249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:28.182184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:28.188463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:28.188912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:28.189674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:28.190138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:28.217960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea87b20d-1210-418d-8a80-18a8be089aaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041221 May 16 17:05:28.218511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 558/1092] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:28.301776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:28.302390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:28.308715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:28.309159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:28.309962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:28.310380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:28.439263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:28.446487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c5f5167e-193b-4eb2-9348-aa1f86e9eaf4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148585 May 16 17:05:28.447044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 535/1093] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:29.230545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:29.231480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:29.237641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:29.238111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:29.238859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:29.239287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:29.267624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7961917e-ea39-4c26-9b4c-ef6af70e5abd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041731 May 16 17:05:29.268195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 559/1094] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:29.464094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:29.464718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:29.471331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:29.471780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:29.472542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:29.472978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:29.597547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:29.605384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-199e7f14-3478-4085-88e3-5d2c52063168 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145846 May 16 17:05:29.605984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 536/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:30.281515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:30.282480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:30.288926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:30.289430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:30.290218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:30.290647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:30.475963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-abaf76a8-a65e-4706-9420-2b93685b2b23 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198235 May 16 17:05:30.476428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 560/1096] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:30.622896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:30.623698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:30.630187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:30.630614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:30.631383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:30.631819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:30.761659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:30.769010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7c0b028-d8d5-43ec-b2da-f3747bab55ad tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149987 May 16 17:05:30.769572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 537/1097] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:31.487520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:31.488424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:31.494601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:31.495040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:31.495784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:31.496209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:31.524412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b81dffd4-f71a-47e5-85e2-2dedbfaa5ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040336 May 16 17:05:31.524949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 561/1098] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:31.785900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:31.786447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:31.792693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:31.793140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:31.793932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:31.794366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:31.920207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:31.927365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7fdb023-3d77-4d5f-b951-afb48bf3dbd5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145448 May 16 17:05:31.927931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 538/1099] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:32.536039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:32.536947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:32.543141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:32.543579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:32.544326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:32.544757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:32.572289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-714f84fb-fa35-4371-875e-019415ba0802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040246 May 16 17:05:32.572820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 562/1100] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:32.944342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:32.944954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:32.951849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:32.952296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:32.953059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:32.953488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:33.085567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:33.093331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d7a8a93b-dc33-46e5-aa97-2632c37ec04c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152927 May 16 17:05:33.093931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 539/1101] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:05:33.582942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:33.583847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:33.590078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:33.590524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:33.591274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:33.591958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:33.619375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4c7a0bd7-8e51-4317-8cd7-5a7e6bc36031 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040369 May 16 17:05:33.619907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 563/1102] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:34.110588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:34.111197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:34.117460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:34.117945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:34.118715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:34.119158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:34.247595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:34.254818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-636b4eeb-a72e-4122-bc14-a6349083088c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148159 May 16 17:05:34.255405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 540/1103] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:34.630829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:34.631747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:34.638635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:34.639091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:34.639850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:34.640286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:34.668415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-762b406a-f3e3-440e-be99-da4b454de051 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041497 May 16 17:05:34.668894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 564/1104] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:35.272393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:35.273004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:35.279844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:35.280289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:35.281047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:35.281478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:35.413870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:35.421624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c3021e02-a47a-47b9-bf31-c3e8ae1af697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153018 May 16 17:05:35.422207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 541/1105] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:35.679982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:35.680896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:35.687284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:35.687726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:35.688493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:35.688930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:35.719273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d4fb4413-92e8-450c-b518-31cd65dd1466 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043260 May 16 17:05:35.719817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 565/1106] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:36.437936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:36.438579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:36.444910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:36.445894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:36.446654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:36.447089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:36.581659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:36.588988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-492d72a6-508d-4906-9992-759e3c50523d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154989 May 16 17:05:36.589564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 542/1107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:36.731108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:36.731939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:36.738162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:36.738610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:36.739402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:36.739834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:36.770201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-98496eb1-28f1-41bf-8391-684c406ed16f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043119 May 16 17:05:36.770749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 566/1108] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:37.606439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:37.607054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:37.613339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:37.613813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:37.614573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:37.615005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:37.741630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:37.749615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e52cc72-d83e-43c8-baf8-871c156c1d6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147020 May 16 17:05:37.750222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 543/1109] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:05:37.780811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:37.781723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:37.787841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:37.788288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:37.789594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:37.790057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:37.818139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bd77eafe-3927-46af-94af-0e33aef37de1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041162 May 16 17:05:37.818691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 567/1110] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:38.766741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:38.767269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:38.774075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:38.774520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:38.775273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:38.775705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:38.829845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:38.830768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:38.837404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:38.837874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:38.838629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:38.839059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:38.867806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-703e7a6e-44a9-4e40-b8e8-40b76afa5662 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041842 May 16 17:05:38.868360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 568/1111] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:38.905582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:38.912872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a8f73adf-e4c2-45b0-a1d4-9caaa6d2ff38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150060 May 16 17:05:38.913444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 544/1112] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:39.878888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:39.879797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:39.886644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:39.887093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:39.887880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:39.888356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:39.916123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f609faf-c1ec-427a-a89c-10944c2360da tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041215 May 16 17:05:39.916661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 569/1113] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:39.931081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:39.931701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:39.937980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:39.938431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:39.939198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:39.939636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:40.069957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:40.077289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7e9efc8-b2fc-4db8-8586-da447593152d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150681 May 16 17:05:40.077878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 545/1114] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:40.927744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:40.928684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:40.934871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:40.935316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:40.936071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:40.936501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:40.964792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d15fbf9f-8547-4658-b09d-6e084d9fd411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041034 May 16 17:05:40.965334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 570/1115] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:41.094564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:41.095182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:41.101567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:41.102071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:41.102842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:41.103280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:41.226807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:41.234044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-078a4c18-b583-45c3-a5d6-605bde1b0595 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.143558 May 16 17:05:41.234607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 546/1116] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:41.977244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:41.978172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:41.984321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:41.984763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:41.985516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:41.985974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:42.013381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-068d93df-8949-409e-b713-ab533c017391 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040725 May 16 17:05:42.013954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 571/1117] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:42.251891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:42.252435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:42.259253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:42.259710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:42.260477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:42.260933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:42.392563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:42.399768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a9001c7d-b6ef-4827-9082-c53df97415cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151950 May 16 17:05:42.400335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 547/1118] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:43.025123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:43.026077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:43.032329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:43.032778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:43.033545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:43.034016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:43.066973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2f72915b-4f3f-47ea-8cb4-adee94f04a85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045774 May 16 17:05:43.067478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 572/1119] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:43.416969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:43.417608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:43.424294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:43.424737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:43.425495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:43.425955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:43.552080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:43.559429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4dc19bcd-8775-4d41-b96b-39236bb0c873 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146897 May 16 17:05:43.559993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 548/1120] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:44.077833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:44.078988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:44.085146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:44.085591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:44.086393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:44.086829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:44.114882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-78dbfd26-867a-4f9b-add1-0ba15e1606f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041011 May 16 17:05:44.115444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 573/1121] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:44.576536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:44.577088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:44.584569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:44.585015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:44.585801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:44.586234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:44.715959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:44.723508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cefc9b0c-1eae-4d8b-88ec-f4b04b6950fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150958 May 16 17:05:44.724069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 549/1122] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:45.127103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:45.128013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:45.134462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:45.134913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:45.135669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:45.136099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:45.163903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fb853f0a-5da3-4678-a251-2dc032db2698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040802 May 16 17:05:45.164444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 574/1123] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:45.793035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:45.793601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:45.799430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:45.799873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:45.800630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:45.801085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:45.926434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:45.933756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55f84bfb-a348-4cdb-a97d-56a750707bf1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145382 May 16 17:05:45.934345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 550/1124] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:46.175532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:46.176442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:46.182689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:46.183139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:46.183899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:46.184335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:46.213062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-250c9afa-f89c-406d-9fde-83cb8874470a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041478 May 16 17:05:46.213606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 575/1125] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:46.950667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:46.951355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:46.958335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:46.958787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:46.959553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:46.959994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:47.085675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:47.094330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b73d56fc-0815-44e1-aa0a-434d18edd2bd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147531 May 16 17:05:47.094909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 551/1126] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:47.224344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:47.225257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:47.231447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:47.231892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:47.232654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:47.233085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:47.261435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9c4448e2-cd48-459a-b305-074ae75249cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040999 May 16 17:05:47.262013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 576/1127] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:48.111448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:48.112063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:48.118932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:48.119385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:48.120155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:48.120592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:48.251049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:48.258315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a6fe8db4-0f06-4fc2-ab99-1d40cf15866f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150732 May 16 17:05:48.258880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 552/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:48.272335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:48.273247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:48.279410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:48.279857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:48.280611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:48.281044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:48.309284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eb33b2bb-5f1d-4b41-bca7-fdc3ed1107f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040857 May 16 17:05:48.309845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 577/1129] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:49.275923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:49.276532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:49.282783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:49.283228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:49.283991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:49.284419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:49.320444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:49.321360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:49.327652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:49.328100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:49.328867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:49.329301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:49.360072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b483ef4-e1f5-4efb-87f3-2bb56b01ba60 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043509 May 16 17:05:49.360624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 578/1130] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:49.411637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:49.419570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a809c547-7189-46ff-8bb2-fba35b790695 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147994 May 16 17:05:49.420158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 553/1131] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:50.371132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:50.372029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:50.378287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:50.378733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:50.379514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:50.379948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:50.409571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-89ef9763-eb16-49d9-ad1c-2fb5f6d657c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042340 May 16 17:05:50.410163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 579/1132] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:50.436255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:50.436871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:50.443189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:50.443635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:50.444391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:50.445337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:50.574008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:50.581251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0b7fa83f-29eb-434b-874e-bc4b80c94db9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148848 May 16 17:05:50.581834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 554/1133] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:51.422231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:51.423143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:51.429346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:51.429827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:51.430709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:51.431145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:51.458806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ed23e87b-a2e4-44d3-877d-ec1b9578ec9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040511 May 16 17:05:51.459346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 580/1134] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:51.598725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:51.599370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:51.605660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:51.606138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:51.606895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:51.607327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:51.731667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:51.738868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-caf04241-dd72-4f98-a29e-12881f51a1c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144048 May 16 17:05:51.739431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 555/1135] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:51 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:05:52.471286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:52.472187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:52.479088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:52.479533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:52.480289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:52.480716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:52.508624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7c213114-a5f4-402b-a229-4865d963751f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041305 May 16 17:05:52.509159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 581/1136] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:52.756498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:52.757045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:52.763324 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:52.763798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:52.764543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:52.764981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:52.893285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:52.900622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ba2b7825-62ae-40c4-83f1-acfe2ade12fe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148136 May 16 17:05:52.901193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 556/1137] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:53.520390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:53.525224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:53.531608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:53.532056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:53.532822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:53.533253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:53.564677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bab78d4d-c718-4cdc-9d8e-09b676ce5b34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048289 May 16 17:05:53.565232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 582/1138] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:53.918434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:53.919065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:53.925529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:53.926023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:53.926816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:53.927262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:54.062947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:54.070478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb7f6504-3476-459f-8a15-586539970570 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.156069 May 16 17:05:54.071791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 557/1139] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:54.577133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:54.578086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:54.584348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:54.584793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:54.585554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:54.586019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:54.613695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9350ffdd-adcd-465b-9f58-d39e1956369f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040574 May 16 17:05:54.614273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 583/1140] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:55.088019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:55.088642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:55.095472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:55.095928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:55.096706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:55.097145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:55.224607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:55.232496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6f705836-3774-4f25-8026-f525da8aec23 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148404 May 16 17:05:55.233074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 558/1141] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:55.624923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:55.625888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:55.632089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:55.632541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:55.633305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:55.634287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:55.662357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-80557bcb-de91-4131-b178-3c8bfd0d87dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041452 May 16 17:05:55.662905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 584/1142] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:56.249545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:56.250195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:56.256563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:56.257013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:56.257804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:56.258247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:56.389323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:56.396623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-873c029f-6708-4ffa-a0d2-1a4ee0691ad4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150945 May 16 17:05:56.397188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 559/1143] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:56.674066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:56.674975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:56.682024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:56.682468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:56.683213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:56.683641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:56.720551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2ed68a3d-86c1-4024-868c-6c8cabc2be1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050378 May 16 17:05:56.721137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 585/1144] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:57.415362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:57.415973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:57.422228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:57.422677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:57.423446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:57.423880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:57.549371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:57.557064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-67383c99-ddac-4c0f-9ded-ebef22e799ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145605 May 16 17:05:57.557626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 560/1145] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:57.732498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:57.733333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:57.739573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:57.740022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:57.740777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:57.741210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:57.769483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-501ea4a7-e9b1-4fcf-a698-ff230c2fb0f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040989 May 16 17:05:57.770241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 586/1146] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:58.574048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:58.574666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:58.581058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:58.581514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:58.582305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:58.582745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:58.713699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:58.721173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0413e97b-4f9d-498f-a7fa-3fc58e433584 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151020 May 16 17:05:58.721748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 561/1147] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:05:58.780855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:58.781772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:58.787921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:58.788361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:58.789110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:58.789534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:58.816810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41b822cf-8fd1-4c87-9d3d-0cc443868b1d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039853 May 16 17:05:58.817355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 587/1148] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:05:59.738439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:59.738977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:59.745722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:59.746194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:59.746956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:59.747385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:59.828347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:05:59.829287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:05:59.835581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:59.836028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:59.836789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:05:59.837221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:05:59.865127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3ed76788-c557-43ee-a1a5-22e0a1a8471a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040690 May 16 17:05:59.865682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 588/1149] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:05:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:05:59.874249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:05:59.881527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1e1e1a37-79cf-4fed-a6fb-9c06545a7088 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147083 May 16 17:05:59.882118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 562/1150] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:05:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:00.877182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:00.878120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:00.884361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:00.884804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:00.885548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:00.886007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:00.899075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:00.899829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:00.905993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:00.906436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:00.907201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:00.907630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:00.914365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1c222f59-b0ab-4a96-b184-b707abef6b71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041165 May 16 17:06:00.915465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 589/1151] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:01.033429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:01.040732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0f54f763-6cd2-4567-b214-4322e62a58b6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145633 May 16 17:06:01.041303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 563/1152] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:06:01.926509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:01.927414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:01.933558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:01.934027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:01.934775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:01.935202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:01.963874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-03be6a25-052f-4458-a196-3f783db532c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041332 May 16 17:06:01.964419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 590/1153] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:02.058121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:02.058797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:02.065058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:02.065513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:02.066317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:02.066757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:02.194804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:02.202042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9a066181-82b2-426e-80bd-a0b428e9e22b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148260 May 16 17:06:02.202618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 564/1154] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:02.975723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:02.976628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:02.983344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:02.983781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:02.984532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:02.984958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:03.012129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-81dab1e4-9785-4f27-bd3e-501f3ea00821 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040502 May 16 17:06:03.012669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 591/1155] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:03.219474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:03.220092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:03.226445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:03.226902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:03.227670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:03.228107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:03.355838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:03.363214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c1368dff-84a7-4b3e-b05e-638a5400f86f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147948 May 16 17:06:03.363787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 565/1156] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:04.023830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:04.024768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:04.030947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:04.031390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:04.032151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:04.032578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:04.060644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-09863f0f-7a9b-492f-b7e9-1c5c79cb04dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040795 May 16 17:06:04.061180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 592/1157] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:04.380483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:04.381098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:04.387496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:04.387949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:04.388713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:04.389149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:04.523411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:04.530744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-85b967c9-991c-46ca-ae02-1f8f8703afbe tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154183 May 16 17:06:04.531305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 566/1158] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:05.072583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:05.073427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:05.079706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:05.080132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:05.080895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:05.081330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:05.110139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-48e7e240-88ee-4304-920c-ae990448009f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042160 May 16 17:06:05.110685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 593/1159] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:05.548038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:05.548663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:05.555076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:05.555532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:05.556302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:05.556741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:05.685969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:05.693206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-62b3bf24-fab3-42e9-ab4a-b6cd8a464030 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149166 May 16 17:06:05.693790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 567/1160] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:06.121382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:06.122322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:06.128505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:06.128949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:06.129698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:06.130151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:06.157243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4378e86f-ca44-4727-8fa1-be0fa5340e37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040421 May 16 17:06:06.157799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 594/1161] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:06.710653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:06.711181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:06.718307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:06.718762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:06.719533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:06.719969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:06.850200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:06.858068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aa1719f2-2db6-4be7-9d2d-434d68ca95d2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.151328 May 16 17:06:06.858635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 568/1162] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:07.168581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:07.169497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:07.175749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:07.176195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:07.176962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:07.177396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:07.205293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-605e5d25-f6f5-4c3a-83c3-0e3356f29243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041263 May 16 17:06:07.205852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 595/1163] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:07.875449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:07.876071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:07.882485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:07.882943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:07.884219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:07.884661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:08.009317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:08.016621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f4bda53-8161-4356-956b-869b190fc9db tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145042 May 16 17:06:08.017199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 569/1164] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:08.217020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:08.217870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:08.224051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:08.224495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:08.225246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:08.225670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:08.253207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-69930992-88b8-4382-987a-15234c00445e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040588 May 16 17:06:08.253752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 596/1165] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:09.033508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:09.034160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:09.041053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:09.041502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:09.042287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:09.042716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:09.167360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:09.174653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4df4b5d4-5110-458b-bcb4-c131c5959723 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144999 May 16 17:06:09.175220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 570/1166] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:09.264796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:09.265708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:09.271936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:09.272379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:09.273132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:09.273565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:09.301586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c7122f15-8881-43d7-85d6-6bf691707a33 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040826 May 16 17:06:09.302195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 597/1167] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:10.191342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:10.191988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:10.198307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:10.198757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:10.199521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:10.199960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:10.312666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:10.313601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:10.319839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:10.320290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:10.321054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:10.321488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:10.329407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:10.337237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1461bc02-d62b-465f-b28d-6977d9185e48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149369 May 16 17:06:10.337834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 571/1168] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:10.355236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2fb30d21-5648-42c3-8f74-c68180247d49 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046572 May 16 17:06:10.355779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 598/1169] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:11.355018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:11.355635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:11.362059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:11.362517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:11.363287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:11.363724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:11.367115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:11.368786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:11.374760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:11.375206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:11.375961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:11.376387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:11.404561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-30ac2872-bb0e-45b3-81ef-0678b0b63669 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041924 May 16 17:06:11.405437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 599/1170] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:11.493600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:11.500841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-13aca3e8-f818-4c9f-b5fb-7fd216c93dba tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150197 May 16 17:06:11.501406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 572/1171] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:12.416765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:12.417674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:12.423911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:12.424353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:12.425110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:12.425540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:12.453811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-615ba4bd-7787-4708-ab0f-e60e3b196f3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041528 May 16 17:06:12.454362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 600/1172] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:12.517854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:12.518502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:12.525452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:12.525940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:12.526716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:12.527157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:12.656230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:12.663568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e24b5700-156f-4aa5-b02f-220f39ebfa76 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149659 May 16 17:06:12.664139 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 573/1173] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:13.465991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:13.467193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:13.473429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:13.473920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:13.474684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:13.475119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:13.503286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c687dba3-96ae-4ae2-910c-6f4a513aee30 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041262 May 16 17:06:13.503839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 601/1174] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:13.682332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:13.682879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:13.689137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:13.689588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:13.690390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:13.690828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:13.819084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:13.826362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a05a0bd0-f483-4133-b360-f29964754c16 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148569 May 16 17:06:13.826942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 574/1175] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:14.515552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:14.516474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:14.522526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:14.522978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:14.523745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:14.524847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:14.552932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4e03493b-1dc6-41c6-9fde-4012ab50e078 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041425 May 16 17:06:14.553495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 602/1176] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:14.843157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:14.844037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:14.850293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:14.850739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:14.851496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:14.851924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:14.977754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:14.984980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d3db0b48-9517-459a-87f8-68c4fcc10739 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145944 May 16 17:06:14.985542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 575/1177] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:15.564266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:15.565172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:15.571971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:15.572402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:15.573153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:15.573579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:15.603145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e163e5dd-8085-4718-acbe-918b17b03412 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042786 May 16 17:06:15.603701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 603/1178] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:16.002271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:16.002889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:16.009199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:16.009653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:16.010453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:16.010892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:16.138881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:16.146095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-32904b15-746c-455b-96c3-d8c2dcfc1fc7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147615 May 16 17:06:16.146666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 576/1179] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:16.614715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:16.615671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:16.621897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:16.622344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:16.623102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:16.623535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:16.654085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-87481314-8f09-43d5-9eb0-893dbb09dfbd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043141 May 16 17:06:16.655651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 604/1180] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:17.162289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:17.162927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:17.169783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:17.170232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:17.170988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:17.171417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:17.296128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:17.303491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b5634e4a-c0a5-4f36-8644-bfe7fc1772f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145042 May 16 17:06:17.304073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 577/1181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:17.666796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:17.667628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:17.674013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:17.674462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:17.675221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:17.675655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:17.703561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0885f1ac-49b4-43ea-9d56-2a03c9afcfb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040829 May 16 17:06:17.704101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 605/1182] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:18.320409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:18.321028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:18.327427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:18.327877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:18.328643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:18.329077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:18.466674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:18.473983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1ddacd96-978f-4c03-a36c-f1c9f0b14710 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.157454 May 16 17:06:18.474556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 578/1183] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:18.715898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:18.717068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:18.723349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:18.723796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:18.724549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:18.724983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:18.753243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-16258ae4-bba2-4cae-b399-533fcaea33d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041831 May 16 17:06:18.753835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 606/1184] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:19.491978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:19.492621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:19.498936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:19.499391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:19.500165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:19.500606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:19.626752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:19.634550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-62c5b178-f2c9-47e7-a33f-9de9d370356e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146525 May 16 17:06:19.635113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 579/1185] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:06:19.765154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:19.766023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:19.772257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:19.772705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:19.773467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:19.774596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:19.802276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fb380ad6-6b5f-4694-813a-77d9d2b5a1fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041162 May 16 17:06:19.802823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 607/1186] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:20.651985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:20.652592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:20.658884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:20.659338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:20.660116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:20.660547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:20.790248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:20.797491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ea292a88-a760-46aa-8e25-eaa4b72f372a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149917 May 16 17:06:20.798097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 580/1187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:20.813846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:20.814758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:20.820907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:20.821898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:20.822667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:20.823104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:20.851786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7fb77a9e-cb0c-4854-8902-7dfc64759267 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041862 May 16 17:06:20.852365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 608/1188] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:21.814617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:21.815185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:21.822014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:21.822466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:21.823258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:21.823695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:21.863465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:21.864546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:21.871227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:21.871677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:21.872442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:21.872881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:21.901686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f2802546-dfc0-421a-a2a4-639d42599fe9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042200 May 16 17:06:21.902269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 609/1189] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:21.950056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:21.957359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e1a80577-5dc7-473b-a011-73b7e1a66b4a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146751 May 16 17:06:21.957957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 581/1190] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:22.913228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:22.914180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:22.921052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:22.921493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:22.922276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:22.922728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:22.949807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a0898962-ee38-4cc0-893b-c464800f73b5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040550 May 16 17:06:22.950340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 610/1191] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:22.974810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:22.975422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:22.982362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:22.982811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:22.983564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:22.983994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:23.111066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:23.118411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b872adfe-12c9-486c-95ed-2d3c1b8a4519 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147439 May 16 17:06:23.118981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 582/1192] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:23.961304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:23.962828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:23.969190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:23.969633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:23.970412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:23.970842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:23.997921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4aef06e3-a6a3-459e-91b2-be205b27ee2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040557 May 16 17:06:23.998459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 611/1193] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:24.135488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:24.136105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:24.142558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:24.143010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:24.143778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:24.144215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:24.271989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:24.279215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7a2b97f3-e4cd-4036-92cc-aad540bbe790 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148221 May 16 17:06:24.279783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 583/1194] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:25.009563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:25.010484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:25.017127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:25.017578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:25.018392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:25.018827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:25.057670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-717e00ec-1498-4967-bd9a-127aed345114 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052630 May 16 17:06:25.058272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 612/1195] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:25.296703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:25.297323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:25.303638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:25.304089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:25.304854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:25.306779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:25.440453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:25.447702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3dd7cdbc-2ef7-495e-b3fa-9ef409d0e3ae tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154938 May 16 17:06:25.448266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 584/1196] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:26.069496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:26.070474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:26.077184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:26.077626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:26.078419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:26.078839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:26.106959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-90286e9a-f84c-4b6a-b528-d7f4d250d5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041447 May 16 17:06:26.107497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 613/1197] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:26.465166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:26.465803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:26.472316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:26.472760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:26.473520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:26.473990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:26.607775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:26.614976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-161f33f1-a340-4d99-ac8d-a0a0430e5263 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154206 May 16 17:06:26.615544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 585/1198] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:27.118966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:27.119896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:27.126086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:27.126546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:27.127285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:27.127826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:27.156025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b98c70da-09a5-4e62-965c-3ca2973f317c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041689 May 16 17:06:27.156572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 614/1199] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:27.632103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:27.632715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:27.639711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:27.640167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:27.640937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:27.641375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:27.766602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:27.773840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-243bc689-e4f7-4072-9ca0-83e96a6d4eaf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145701 May 16 17:06:27.775024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 586/1200] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:28.167659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:28.168573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:28.174875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:28.175321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:28.176075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:28.176507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:28.204957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-367b2036-3dc6-49ee-922f-d8be55e67d0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 May 16 17:06:28.205503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 615/1201] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:28.792042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:28.792660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:28.798982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:28.799433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:28.800201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:28.800638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:28.928951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:28.936421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-17f5df1b-246d-4f23-988a-1c0130cc6a77 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148879 May 16 17:06:28.936985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 587/1202] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:29.217470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:29.218395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:29.224624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:29.225067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:29.225853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:29.226282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:29.253167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7d698a45-9c71-43e4-a207-3c6a24ec5d68 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040014 May 16 17:06:29.253699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 616/1203] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:29.953497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:29.954168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:29.960431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:29.960882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:29.961649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:29.962276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:30.089826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:30.097376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cfedc325-5704-48a0-a571-a9aa76f64c9e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147787 May 16 17:06:30.097982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 588/1204] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:30.263726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:30.264642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:30.270821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:30.271269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:30.272024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:30.272462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:30.300856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9a7e7e16-3722-47bc-9815-20c313c6e459 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041109 May 16 17:06:30.301399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 617/1205] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:31.115244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:31.115762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:31.122151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:31.122604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:31.123369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:31.123809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:31.249148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:31.256305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0af3b9e2-57b0-46fc-a609-a1438066a0a8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145053 May 16 17:06:31.256869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 589/1206] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:31.312199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:31.313110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:31.319227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:31.319653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:31.320402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:31.321363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:31.349269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da31e314-5952-4b3e-9d77-a7f53caba723 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041004 May 16 17:06:31.349823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 618/1207] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:32.273833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:32.275029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:32.281286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:32.281730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:32.282513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:32.282942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:32.361177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:32.361656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:32.368464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:32.368918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:32.369687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:32.370157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:32.399184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-360c709a-593f-441f-9b2d-092d507c98b0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042351 May 16 17:06:32.399755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 619/1208] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:32.412782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:32.420265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8d9605fd-efb6-4098-9c0b-20174f9a0c19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150255 May 16 17:06:32.421054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 590/1209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:33.410914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:33.411867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:33.418173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:33.418618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:33.419377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:33.419811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:33.436389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:33.437093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:33.443465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:33.443914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:33.444681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:33.445109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:33.448728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cfa4aea8-2eb7-4e9c-a119-f8faec21eb43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041823 May 16 17:06:33.449291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 620/1210] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:33.578747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:33.586021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1900c686-bc97-456a-a125-84170e2b3d56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153514 May 16 17:06:33.586601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 591/1211] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:34.460357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:34.461266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:34.468309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:34.468754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:34.469499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:34.469955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:34.497551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-432107dc-281a-4c9c-9021-4b104eb50802 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041178 May 16 17:06:34.498447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 621/1212] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:34.603876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:34.604489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:34.610819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:34.611265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:34.612019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:34.612453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:34.741333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:34.748544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-229cf1ce-23bd-4bd6-9a63-4e323d81ac6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149170 May 16 17:06:34.749103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 592/1213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:35.509454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:35.510399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:35.516762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:35.517215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:35.517994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:35.518439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:35.547298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-297f7c46-15b3-40a3-9834-4bdd3aaef7fa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041831 May 16 17:06:35.547855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 622/1214] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:35.765695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:35.766255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:35.772549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:35.772999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:35.773789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:35.774876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:35.899941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:35.907254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6385c16f-8fc8-42df-9762-2a50e87f5239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145564 May 16 17:06:35.907815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 593/1215] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:36.559388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:36.560295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:36.566491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:36.566934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:36.567686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:36.568116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:36.595534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b9a3f4e-fb8a-4e17-990a-a6366240e32e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040838 May 16 17:06:36.596067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 623/1216] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:36.924166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:36.924781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:36.931394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:36.931849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:36.932616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:36.933048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:37.058312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:37.065571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1da373ba-6b8c-4c86-b26b-e13f39d7f231 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145303 May 16 17:06:37.066164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 594/1217] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:37.607723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:37.608619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:37.614843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:37.615292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:37.616043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:37.616470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:37.644084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-de6dc7d8-d614-48d3-9132-b916e1acedc1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040348 May 16 17:06:37.644626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 624/1218] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:38.082908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:38.083517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:38.089911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:38.090361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:38.091120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:38.091817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:38.224596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:38.232360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-86b7d246-2533-4a77-9018-274d7445de0d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153355 May 16 17:06:38.232926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 595/1219] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:38.507144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:06:38.507410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:06:38.655589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:38.656497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:38.662998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:38.663471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:38.664272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:38.665255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:38.694818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-42d5a9e8-67a7-4552-851d-bf0d1808e698 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043175 May 16 17:06:38.695359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 625/1220] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:39.249639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:39.250285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:39.256602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:39.257052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:39.257844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:39.258893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:39.382762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:39.390736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a7aab1a0-34a5-43c0-bfbe-f3fdc4bd4d47 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144977 May 16 17:06:39.391304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 596/1221] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:39.706449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:39.707366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:39.713614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:39.714094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:39.714853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:39.715287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:39.744987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c9be28ab-5a30-42c5-8365-a913710f8bf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042554 May 16 17:06:39.745555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 626/1222] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:40.408001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:40.408613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:40.415435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:40.416037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:40.416813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:40.417249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:40.553316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:40.560781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-589ef249-1f0c-491e-b50b-612ea14cbffc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.156624 May 16 17:06:40.561300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 597/1223] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:40.756627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:40.757569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:40.764520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:40.764976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:40.765728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:40.766214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:40.793413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-04bab465-0a5d-4760-8df0-53d7c5a6519c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040805 May 16 17:06:40.794005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 627/1224] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:41.577915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:41.578463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:41.584735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:41.585180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:41.585968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:41.586905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:41.715802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:41.723499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9d6c62cc-0801-4c15-bf20-f37bb492deda tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149535 May 16 17:06:41.724064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 598/1225] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:41.804531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:41.805606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:41.812034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:41.812489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:41.813253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:41.813690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:41.844106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-400adc2a-3897-40e2-befb-f5ee0a76da97 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043480 May 16 17:06:41.844675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 628/1226] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:42.741568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:42.742157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:42.748463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:42.748908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:42.749667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:42.750125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:42.856136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:42.857051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:42.863228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:42.863726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:42.864484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:42.864908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:42.882766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:42.890731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-03d68c6d-b9f7-4f6a-8a01-6883a776051f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153033 May 16 17:06:42.891298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 599/1227] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:42.893900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2bc7f66c-e13a-4e14-a1d7-3469ff0f1877 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041687 May 16 17:06:42.894485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 629/1228] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:43.905472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:43.906435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:43.907514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:43.908126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:43.912641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:43.913098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:43.913901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:43.914326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:43.914457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:43.914771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:43.915527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:43.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:43.943230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ee480690-7413-4b62-84c1-46448a989116 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041780 May 16 17:06:43.943793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 600/1229] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:44.088082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:44.095801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-38248d82-454a-4f6c-a9fe-5da7dbd875e5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.192011 May 16 17:06:44.096520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 630/1230] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:06:44.955506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:44.956426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:44.963201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:44.963654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:44.964421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:44.964865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:44.994181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-11e510df-8f00-4dd7-8511-45eff51fb6db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042783 May 16 17:06:44.994739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 601/1231] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:45.113874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:45.114405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:45.121043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:45.121497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:45.122298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:45.122733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:45.250365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:45.257613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3a6eff57-c894-4b5b-963a-7c3827cdcc45 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147663 May 16 17:06:45.258237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 631/1232] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:45.352716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:06:45.352903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:06:46.005902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:46.006818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:46.013711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:46.014191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:46.014947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:46.015377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:46.044495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f06d0558-3b04-4ed5-af4e-a0f55e690ef2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042991 May 16 17:06:46.045031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 602/1233] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:46.274499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:46.275632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:46.281835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:46.282280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:46.283059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:46.283487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:46.410183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:46.418178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-268ef363-78c9-49f3-9400-586229efec00 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147531 May 16 17:06:46.418734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 632/1234] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:46.833977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:06:46.834210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:06:47.119364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:47.120381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:47.126249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:47.126706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:47.127484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:47.127929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:47.156290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-25eca116-29ed-48cc-b88d-5d8f1dc7c79a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104306 May 16 17:06:47.156844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 603/1235] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:47.434780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:47.435422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:47.441689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:47.442169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:47.442935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:47.443369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:47.567649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:47.575018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-493536e8-e362-4af9-9489-5a9c7625338d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144118 May 16 17:06:47.575583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 633/1236] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:48.168083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:48.169012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:48.175376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:48.175832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:48.176605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:48.177054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:48.205598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a0368a03-b0b3-4a43-b818-3359277ada93 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041510 May 16 17:06:48.206221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 604/1237] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:48.592208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:48.592818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:48.599191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:48.599645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:48.600404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:48.600837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:48.730255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:48.737420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c4859a05-eb80-4ccd-8747-9ba706f1832f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149313 May 16 17:06:48.738016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 634/1238] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:49.217659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:49.218525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:49.224737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:49.225184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:49.225972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:49.226408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:49.254941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e0f74a7a-c1b6-43d5-9d25-0cc7c2fe54bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041702 May 16 17:06:49.255477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 605/1239] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:49.759603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:49.760342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:49.766698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:49.767597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:49.767922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:49.768348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:49.893836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:49.901069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-48772437-dc19-4f44-985f-3ee075e6737b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145960 May 16 17:06:49.901631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 635/1240] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:50.266570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:50.267507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:50.273761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:50.274217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:50.274975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:50.275466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:50.303621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9329ad47-2f89-47e4-a34f-64f70c7decc0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041091 May 16 17:06:50.304165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 606/1241] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:50.917905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:50.918519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:50.924773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:50.925221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:50.926006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:50.926440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:51.054198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:51.062079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f59bb1b6-900d-4531-b0f6-935c338086c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148555 May 16 17:06:51.063136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 636/1242] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:51.316096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:51.317023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:51.323455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:51.323919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:51.324693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:51.325141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:51.354395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-540003c7-8129-4f5f-a3e9-af249100020c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041713 May 16 17:06:51.354953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 607/1243] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:52.079489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:52.083835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:52.087822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:52.087822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:52.088215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:52.088383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:52.214314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:52.221818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-10c975fa-f985-4385-b6b4-5895fa0e30f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.146172 May 16 17:06:52.222384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 637/1244] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:52.365351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:52.366362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:52.373136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:52.373584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:52.374370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:52.374808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:52.404222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-16fd57b9-7cfd-42d7-a8aa-659ec59a4f41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042832 May 16 17:06:52.404775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 608/1245] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:53.239405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:53.239920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:53.246185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:53.246628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:53.247382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:53.247814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:53.373244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:53.380566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-051c2f93-5e6e-48c6-bdb0-205ec7aec9e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145127 May 16 17:06:53.381158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 638/1246] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:06:53.416067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:53.417016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:53.423304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:53.423755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:53.424524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:53.424962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:53.457297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b6317a21-936c-432b-b5d4-34fdf8253b2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044870 May 16 17:06:53.458388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 609/1247] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:54.398214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:54.398851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:54.405616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:54.406106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:54.406864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:54.407290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:54.469660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:54.470643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:54.476904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:54.477361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:54.478163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:54.479194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:54.507879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-482bae6a-f171-47b5-b975-5a313ebcced3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042502 May 16 17:06:54.510138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 610/1248] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:06:54.539387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:54.546736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-629fd9bc-2da0-49a7-ab44-3307c9a5633e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152437 May 16 17:06:54.547306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 639/1249] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:55.519685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:55.520618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:55.528882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:55.529344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:55.530169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:55.530622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:55.560767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8c4c20f5-f6ba-4289-97c9-db5b428017a4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045088 May 16 17:06:55.561342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 611/1250] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:55.564330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:55.564945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:55.571276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:55.571833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:55.573106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:55.573532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:55.717168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:55.726086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3e2fd102-1efe-4e4e-9a1d-452ba4754098 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.164542 May 16 17:06:55.726879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 640/1251] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:06:56.572689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:56.573537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:56.579931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:56.580384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:56.581154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:56.581593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:56.610608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-75337fa6-aa7b-4680-9631-7b891d0b67df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042001 May 16 17:06:56.611153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 612/1252] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:56.745188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:56.745915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:56.752150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:56.752597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:56.753356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:56.753814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:56.886299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:56.893486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-033533d3-5bbf-4e92-8dfe-9af8892aa774 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152266 May 16 17:06:56.894083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 641/1253] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:57.622732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:57.623759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:57.630017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:57.630508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:57.631284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:57.631728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:57.661790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-52d7bfe2-23b9-467a-a7bd-db2f17855cca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043039 May 16 17:06:57.662349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 613/1254] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:57.910678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:57.911237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:57.917512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:57.918019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:57.918776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:57.919210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:58.044190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:58.051409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e1518af3-dd3c-4ed6-8767-0167b6f86bb2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144751 May 16 17:06:58.051963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 642/1255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:58.672723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:58.673637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:58.679986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:58.680434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:58.681195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:58.682157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:58.710012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-067a57a1-bfc6-40ff-b642-3ba884982813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041402 May 16 17:06:58.710550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 614/1256] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:06:59.068294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:59.068939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:59.075180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:59.075630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:59.076390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:59.076824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:59.205105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:06:59.212475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a9e607c9-1105-4080-a1e5-b0564cdee973 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148045 May 16 17:06:59.213042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 643/1257] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:06:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:06:59.721967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:06:59.722812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:06:59.729903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:59.730357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:59.731122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:06:59.731555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:06:59.759072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dd40b169-b2cf-44e2-baee-8bf912f8b26e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041285 May 16 17:06:59.760119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 615/1258] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:06:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:07:00.229925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:00.230547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:00.236827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:00.237298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:00.238067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:00.238506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:00.362907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:00.370643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d527047d-b667-4c43-b790-5b7d4ed1101b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144677 May 16 17:07:00.371210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 644/1259] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:00.772386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:00.773404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:00.780071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:00.780538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:00.781317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:00.781788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:00.810682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e7676e77-a705-4584-bca9-400304091191 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042397 May 16 17:07:00.811236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 616/1260] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:07:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:07:01.388373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:01.389013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:01.395375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:01.395822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:01.396581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:01.397016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:01.521970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:01.529774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-484feee5-7c79-40bb-bf5a-65c3324ebf37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145761 May 16 17:07:01.530325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 645/1261] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:01.823030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:01.823875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:01.830401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:01.830860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:01.831638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:01.832078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:01.860138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6ebc129f-2b73-49eb-b719-bf49010e9d89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041831 May 16 17:07:01.860686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 617/1262] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:07:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:07:02.546925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:02.547540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:02.553839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:02.554289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:02.555048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:02.555481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:02.684434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:02.691682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-080b1c84-5cda-47f3-9268-9e2f086d5716 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148552 May 16 17:07:02.692256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 646/1263] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:02.871872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:02.872787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:02.879092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:02.879537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:02.880296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:02.880727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:02.909378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b5b81383-142f-40e9-a510-ca68b098b76a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041468 May 16 17:07:02.909941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 618/1264] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:07:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:07:03.708259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:03.708829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:03.715094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:03.715538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:03.716564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:03.716994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:03.844474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:03.851666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-45f78be3-d330-490c-b3ee-48f830e4ca5d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147276 May 16 17:07:03.852303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 647/1265] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:03.920279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:03.921203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:03.927413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:03.927867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:03.928644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:03.929058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:03.957701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c0a22c0c-b02a-4b4d-ab85-31b2d8dd5176 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041411 May 16 17:07:03.958327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 619/1266] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:07:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:07:04.868826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:04.869442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:04.875699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:04.876141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:04.876899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:04.877331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:04.969153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:04.970227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:04.976246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:04.976699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:04.977474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:04.977946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:05.007239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5709ba6d-7dff-42fb-b9ec-fb7550f48eed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042149 May 16 17:07:05.007816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 620/1267] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:07:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:07:05.010113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:05.017443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-35d96263-452c-4696-828b-e5ffcfae7a27 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152453 May 16 17:07:05.018044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 648/1268] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:06.019330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:06.020247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:06.026498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:06.026940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:06.027696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:06.028127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:06.035040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:06.035655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:06.042395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:06.042846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:06.043617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:06.044058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:06.057393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-442bf8ec-1afc-4aff-bb3b-e649d0637a73 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041462 May 16 17:07:06.057981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 621/1269] 10.222.0.70 () {60 vars in 1342 bytes} [Mon May 16 17:07:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:07:06.171599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:06.179003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83c37da7-e624-4375-bff4-8988f3165b3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147814 May 16 17:07:06.179566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 649/1270] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:07.068790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:07.069703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:07.076156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:07.076587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:07.077345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:07.077805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:07.103940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR oslo.messaging._drivers.impl_rabbit [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [660bb763-341c-4d82-a91e-0b9036ce4fd2] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 17:07:07.196087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:07.196699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:07.202971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:07.203422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:07.204176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:07.204610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:07.329591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:07.336811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-486dbf3b-6153-4796-89ee-48fd3e829b86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144583 May 16 17:07:07.337371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 650/1271] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:08.109964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [660bb763-341c-4d82-a91e-0b9036ce4fd2] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 41612. May 16 17:07:08.184484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-460b7f7b-3040-425c-a9df-0f40ec330da4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/action" status: 200 len: 37690 microversion: 2.20 time: 1.119670 May 16 17:07:08.185135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 622/1272] 10.222.0.70 () {62 vars in 1318 bytes} [Mon May 16 17:07:07 2022] POST /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de/action => generated 37690 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 16 17:07:08.354493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:08.355113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:08.361357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:08.361766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:08.362523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:08.362958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:08.491446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:08.499388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-15dca0ef-3b67-46eb-a6ec-f7d7c9af998e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148757 May 16 17:07:08.499943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 651/1273] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:09.516261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:09.516973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:09.524018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:09.524480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:09.525253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:09.525714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:09.699686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:09.707202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4b7b977b-936a-42b3-8c17-1ce242bceee1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.195182 May 16 17:07:09.707771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 623/1274] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:10.724587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:10.725118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:10.734610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:10.735063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:10.735837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:10.736276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:10.863672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:10.871351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6753d8f4-9e97-48c0-ad64-baa1e086951b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150740 May 16 17:07:10.871924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 652/1275] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:11.888598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:11.889219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:11.895520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:11.895967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:11.896746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:11.897179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:12.021652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:12.028949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce4bd5a4-acb1-4e96-957e-52ffb2f5dda2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144288 May 16 17:07:12.029519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 624/1276] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:13.046608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:13.047221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:13.053510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:13.053988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:13.054748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:13.055181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:13.192012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:13.199840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4b128247-5235-4b50-96f9-354040547b38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.157179 May 16 17:07:13.200402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 653/1277] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:14.217761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:14.218389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:14.224629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:14.225072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:14.225848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:14.226279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:14.359745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:14.366997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8a188af0-2808-4795-bc03-e2b1b2e785a4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.153375 May 16 17:07:14.367564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 625/1278] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:15.385019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:15.386127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:15.392253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:15.392691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:15.393443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:15.393906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:15.522693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:15.529870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-71a1c260-f6ac-44d1-bf70-11df6efbdd8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149441 May 16 17:07:15.530417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 654/1279] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:16.546940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:16.547582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:16.553945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:16.554404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:16.555175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:16.555615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:16.681025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:16.688934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d2b22e22-c14b-4325-a53f-781ff49b39c7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145889 May 16 17:07:16.689513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 626/1280] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:17.706796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:17.707302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:17.713520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:17.713999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:17.714756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:17.715183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:17.843228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:17.850519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-76ac39a2-f5a1-4e92-94ed-39c33f02aa9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147579 May 16 17:07:17.851094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 655/1281] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:18.867989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:18.869125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:18.875483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:18.875937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:18.876720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:18.877162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:19.007034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:19.014970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cd77d70c-4b48-422c-a0c9-6ad7d54da0b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150891 May 16 17:07:19.015539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 627/1282] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:20.031722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:20.032358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:20.038649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:20.039097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:20.039847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:20.040273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:20.172900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:20.180217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aedbfc89-f451-45a3-b459-4fdc7db25b72 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152397 May 16 17:07:20.180778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 656/1283] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:21.197820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:21.198375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:21.204639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:21.205092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:21.205883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:21.206371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:21.329046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:21.336264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1c8c9334-1679-4f5a-9f32-e028f5a165dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.142411 May 16 17:07:21.336827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 628/1284] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:22.354021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:22.354608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:22.360882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:22.361328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:22.362112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:22.362542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:22.491149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:22.498410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cdf9e6f9-95d2-4de3-91a7-d833d135e272 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148213 May 16 17:07:22.498967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 657/1285] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:23.515481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:23.516098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:23.522451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:23.522903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:23.523670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:23.524108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:23.648891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:23.656742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8192f957-3f02-4e19-9472-bb8545cae390 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.145148 May 16 17:07:23.657308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 629/1286] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:24.674525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:24.675058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:24.681239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:24.682312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:24.683296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:24.684043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:24.825550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:24.832820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e91e8d20-a55c-4f48-a1cb-5a7fb8b3342c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.162247 May 16 17:07:24.833380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 658/1287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:25.849627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:25.850294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:25.856620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:25.857071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:25.857865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:25.858300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:25.986478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:25.993695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-866e9ff2-b937-45af-a611-8cd563f478bf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.147940 May 16 17:07:25.994881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 630/1288] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:27.011312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:27.011858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:27.018020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:27.018461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:27.019243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:27.019671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:27.144017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:27.151712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1540dd0c-74fb-49e9-b6e9-663131e542e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144358 May 16 17:07:27.152295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 659/1289] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:28.169111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:28.169762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:28.176066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:28.176517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:28.177280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:28.177717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:28.302021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:28.309245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae2c55b0-e757-4696-bf3c-7e54cb0257b7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144572 May 16 17:07:28.309838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 631/1290] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:29.326355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:29.326912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:29.333108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:29.333552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:29.334355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:29.334788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:29.469564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:29.476822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-64e341de-5685-49fa-853b-95a250daca9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.154417 May 16 17:07:29.477390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 660/1291] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:30.495736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:30.496284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:30.502569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:30.503013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:30.503768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:30.504198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:30.636097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:30.643428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5d79ba84-af0b-41d6-8371-bf45e89cb8e3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.152228 May 16 17:07:30.643994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 632/1292] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:31.659761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:31.660370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:31.666651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:31.667058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:31.667818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:31.668249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:31.793355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:31.800694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d2cbdc2-007f-4975-94c3-d30daea7fecd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144765 May 16 17:07:31.801284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 661/1293] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:32.817792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:32.818338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:32.825289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:32.825757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:32.826549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:32.826991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:32.954818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:32.962119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f5fa17a7-d6c9-4487-9d8d-c01fc24bb09f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.148284 May 16 17:07:32.962721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 633/1294] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:33.980630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:33.981221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:33.987480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:33.987920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:33.988673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:33.989105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:34.118168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:34.125421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-495d5c01-f849-4ab9-be63-9fa4a66785eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.149289 May 16 17:07:34.126009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 662/1295] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:35.142487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:35.143056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:35.149564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:35.150044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:35.150809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:35.151872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:35.275271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:35.283039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3b1f8fc7-0e37-4ec3-9f16-14da4e6931ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.144456 May 16 17:07:35.283608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 634/1296] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:36.300071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:36.300691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:36.306954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:36.307726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:36.308500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:36.308940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:36.439025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:36.446405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7e80e05e-8b1b-46e3-9836-b66a7493800c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.150238 May 16 17:07:36.446970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 663/1297] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:37.463770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:37.464379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:37.471255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.471721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.472482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.472913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.581649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:37.582748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:37.590550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.591318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.592175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.592883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.606046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:37.619576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-07a2c731-e0ea-4097-af23-479d5a62c3e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.159549 May 16 17:07:37.620369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 635/1298] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:37.623656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:07:37.714030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:37.714617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:37.719895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8952b6a9-fb4e-4a82-9e21-a4e40a15ea0c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 204 len: 0 microversion: 2.1 time: 0.141943 May 16 17:07:37.720869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 664/1299] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:07:37 2022] DELETE /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:07:37.723183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.724302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.725519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.726070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.732958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:37.735585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:37.743764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.744329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.745462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:37.746023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:37.882099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:37.890019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3ae7035a-3b04-4cb0-bee1-25c9a1b626e5 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1680 microversion: 2.1 time: 0.163101 May 16 17:07:37.890614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 665/1300] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:37 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:38.638647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:38.639429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:38.645905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:38.646383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:38.647343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:38.647792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:38.862387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:38.872682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0410c62c-9f6b-4cf7-8d6d-d303c60fef09 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.238918 May 16 17:07:38.873347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 666/1301] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:38.878444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:38.879211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:38.885397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:38.886003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:38.886848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:38.887344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:38.918015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:07:39.010603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da450e92-54a7-4214-85a8-c453c944f368 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "DELETE /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 204 len: 0 microversion: 2.1 time: 0.135448 May 16 17:07:39.011630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 667/1302] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:07:38 2022] DELETE /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:07:39.017567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:39.017758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:39.024301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.024760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:39.025596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.026104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:39.123323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:39.131727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a4bcbe5f-77a9-4be6-93b1-c7f6d4aab250 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 200 len: 1612 microversion: 2.1 time: 0.118814 May 16 17:07:39.132436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 668/1303] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:39 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 1612 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:39.137538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:39.138175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:39.144463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.145024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:39.145988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.146468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:39.376073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:39.387428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-91ef687d-ade0-43a6-bb7d-240110328313 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.253784 May 16 17:07:39.389062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 669/1304] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:39 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:39.610750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-e41e0b08-0e97-4dc7-bd7b-176ea00dc4da req-5aafd003-cae8-4629-aa20-0b2ad7359280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cea648-3cec-4a36-b8ee-02d2f4ee9097", "name": "network-vif-deleted", "tag": "d3ef85dc-ef25-4d5a-bec4-b5600df4152d"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:39.619834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e41e0b08-0e97-4dc7-bd7b-176ea00dc4da req-5aafd003-cae8-4629-aa20-0b2ad7359280 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.620697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e41e0b08-0e97-4dc7-bd7b-176ea00dc4da req-5aafd003-cae8-4629-aa20-0b2ad7359280 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:39.631703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-e41e0b08-0e97-4dc7-bd7b-176ea00dc4da req-5aafd003-cae8-4629-aa20-0b2ad7359280 service nova] Creating event network-vif-deleted:d3ef85dc-ef25-4d5a-bec4-b5600df4152d for instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 on hv-cinder-83998 May 16 17:07:39.637399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-e41e0b08-0e97-4dc7-bd7b-176ea00dc4da req-5aafd003-cae8-4629-aa20-0b2ad7359280 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246962 May 16 17:07:39.638120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 670/1305] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:39.896109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:39.897833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:39.905687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.906183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:39.907320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:39.908060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:40.189865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:40.197641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-37d07bb9-0b4d-4a9d-80d6-9fa6ce450f64 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.310426 May 16 17:07:40.199083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 671/1306] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:40.203806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:40.204410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:40.211118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:40.211801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:40.212567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:40.213189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:40.228411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 HTTP/1.1 May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:07:40.230169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:07:40.231878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '84cea648-3cec-4a36-b8ee-02d2f4ee9097'} May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:07:40.232936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:07:40.234547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:07:40.235893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:07:40.235893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ac02e7a9-53f0-4fdc-8988-aff97ccfd6b7 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 404 len: 111 microversion: 2.1 time: 0.031548 May 16 17:07:40.235893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 672/1307] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:40 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:07:40.240334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6adb7ab3-64de-49a9-a0c6-c42760cb16bb tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '.version_select at 0x7feacd7ee160>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:40.265311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6adb7ab3-64de-49a9-a0c6-c42760cb16bb tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975087948" status: 202 len: 0 microversion: 2.1 time: 0.028401 May 16 17:07:40.266632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 673/1308] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 16 17:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975087948 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:07:40.413034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:40.414253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:40.425138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:40.425652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:40.426410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:40.426877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:40.677585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:40.693360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5da34862-bb04-473f-9877-7f7ad1e7924f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.288884 May 16 17:07:40.710141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 674/1309] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:40 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:41.024213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17359cfb-0feb-4516-90ce-4409c7ea0702 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: .version_select at 0x7feacd9f0dc0>, body: {"keypair": {"name": "tempest-keypair-811913824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIoSEKxI8zgNludqYAWOO4QQNt+SuzqJckZNa0I09CGOGNBGd8+7+gOaEFdr4B4v3h/IYrXCLZJ+UOzi50Ibt510eJ7mIQ+a+CfN1LiCb3nVtVqUPh1pEjB1Rs1/e2OCg=="}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:41.042981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-17359cfb-0feb-4516-90ce-4409c7ea0702 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:07:41.047157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-17359cfb-0feb-4516-90ce-4409c7ea0702 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:07:41.077438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17359cfb-0feb-4516-90ce-4409c7ea0702 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057122 May 16 17:07:41.078101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 675/1310] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 17:07:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:07:41.216332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:41.217090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:41.224574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:41.225095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:41.226015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:41.226517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:41.660005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:41.669773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4d99e6f3-db14-4273-a178-d27a78ab475e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.458405 May 16 17:07:41.670812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 676/1311] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:41.718728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:41.720333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:41.729699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:41.730552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:41.732117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:41.732811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:41.952550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:41.982340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-adf89361-23ac-473d-97a4-717437d96c93 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.269456 May 16 17:07:41.985173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 677/1312] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:41 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:42.583911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2052738019", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b"}], "security_groups": [{"name": "tempest-securitygroup--967262327"}], "key_name": "tempest-keypair-811913824", "user_data": "}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:42.733621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] validate_networks() for [('6257c4f0-7ac6-4dbc-9a71-cee00a11ae9b', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:07:43.766074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:07:43.767180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:07:43.767658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:07:43.768067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:07:43.768594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:07:43.778525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:43.778971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:43.779962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:43.780404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:43.798311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:07:43.802427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Getting quotas for user 13a6ce9b67564caab0892fc443073202 and project 43c36b17e1414e208b453d10be94834c. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:07:43.814075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:07:43.816618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:07:43.868206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2e373792-5832-42df-b135-7fe8f9e14cb0 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.289167 May 16 17:07:43.869533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 678/1313] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:07:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:07:43.878018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:43.878993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:43.885482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:43.886527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:43.887972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:43.888572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:44.202060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:44.212740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7fddb5f2-a2aa-424e-b7f6-4cba3528a04d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.341921 May 16 17:07:44.214136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 679/1314] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:44.226414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:44.227896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:44.234314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:44.235098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:44.236185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:44.236943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:44.770396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:44.786430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-091c10fd-25e4-40db-95d8-48e383e859bd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.562231 May 16 17:07:44.787742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 680/1315] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:44 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:44.793950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:44.795340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:44.808371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:44.809038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:44.810382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:44.811050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:44.894079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:44.910638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dd9d2d21-d41b-4bdf-a074-fe95adbd26db tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1293 microversion: 2.1 time: 0.121196 May 16 17:07:44.911949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 681/1316] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:44 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:45.644079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:45.644879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:45.653570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:45.654069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:45.655729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:45.656422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:45.719209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:07:45.855258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4810199c-7f1b-45a9-b7d1-69985f8f9137 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 204 len: 0 microversion: 2.1 time: 0.214995 May 16 17:07:45.862129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 682/1317] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:07:45 2022] DELETE /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 17:07:46.195165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-9d84b88a-0e81-4c43-acda-52c7d5512130 req-81a24e4b-a67a-4111-b043-88d833414589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c2033c-4fee-4884-a6f7-de043836ebad", "tag": "fd7ba01c-f563-4085-b558-b1c5bd0db5a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:46.205295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-9d84b88a-0e81-4c43-acda-52c7d5512130 req-81a24e4b-a67a-4111-b043-88d833414589 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:46.206003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-9d84b88a-0e81-4c43-acda-52c7d5512130 req-81a24e4b-a67a-4111-b043-88d833414589 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:46.222322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-9d84b88a-0e81-4c43-acda-52c7d5512130 req-81a24e4b-a67a-4111-b043-88d833414589 service nova] Creating event network-changed:fd7ba01c-f563-4085-b558-b1c5bd0db5a6 for instance d5c2033c-4fee-4884-a6f7-de043836ebad on hv-cinder-83998 May 16 17:07:46.231767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-9d84b88a-0e81-4c43-acda-52c7d5512130 req-81a24e4b-a67a-4111-b043-88d833414589 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367426 May 16 17:07:46.236907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 683/1318] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:46.243472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:46.244174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:46.261016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:46.261487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:46.262317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:46.263453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:46.534206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:46.545250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-043d561a-7cf9-4749-b3cf-e44f0cbdbd13 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.305063 May 16 17:07:46.547443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 684/1319] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:46 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:46.554236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:46.554836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:46.576687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:46.577547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:46.578703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:46.579671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:47.118895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:47.127808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8291bbb1-f4c8-4674-990f-56c1ba4f00c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1565 microversion: 2.1 time: 0.579136 May 16 17:07:47.128389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 685/1320] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1565 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:47.136720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:47.137543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:47.156659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:47.161043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:47.161930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:47.162373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:47.459451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:47.494118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5a14ea73-5f7e-4694-bcbe-07a8ceb68fca tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.360216 May 16 17:07:47.496514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 686/1321] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:47 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:47.564745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:47.565690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:47.582011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:47.582470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:47.583283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:47.583723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:47.848565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:47.858400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-47d0341e-d875-4690-84cc-b3ddce4cfdb5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.297882 May 16 17:07:47.859705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 687/1322] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:47 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:47.985864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-22c72251-cb72-46ca-8863-098b7ea980b3 req-a613cd9c-aad3-4911-b2de-5f19cff37a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24443e5c-42e0-4bfb-b5be-c856e1dfd645", "tag": "15b82593-cc7e-4a40-a2ba-68178284581c"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:47.994089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-22c72251-cb72-46ca-8863-098b7ea980b3 req-a613cd9c-aad3-4911-b2de-5f19cff37a10 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:47.995906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-22c72251-cb72-46ca-8863-098b7ea980b3 req-a613cd9c-aad3-4911-b2de-5f19cff37a10 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:48.024981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-22c72251-cb72-46ca-8863-098b7ea980b3 req-a613cd9c-aad3-4911-b2de-5f19cff37a10 service nova] Creating event network-changed:15b82593-cc7e-4a40-a2ba-68178284581c for instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 on hv-cinder-83998 May 16 17:07:48.039256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-22c72251-cb72-46ca-8863-098b7ea980b3 req-a613cd9c-aad3-4911-b2de-5f19cff37a10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057662 May 16 17:07:48.040893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 688/1323] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:48.147661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:48.148378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:48.160241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:48.160671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:48.161462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:48.161923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:48.480606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:48.493042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61426091-73d9-4714-afa2-2880231c4487 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.347926 May 16 17:07:48.494753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 689/1324] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:48.517939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:48.520122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:48.530257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:48.531134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:48.532230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:48.533419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:48.751049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:48.758778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab998f26-d877-4cff-983f-d527c3dc70e2 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.249341 May 16 17:07:48.769560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 690/1325] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:48 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:48.876659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:48.882533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:48.890301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:48.890742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:48.891693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:48.892407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:49.087011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:49.096273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-81feeaaf-9e21-4c1d-8a3e-c8979855210e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.224312 May 16 17:07:49.106713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 691/1326] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:48 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:49.512298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:49.512945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:49.519135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:49.519581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:49.520350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:49.520781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:49.845570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:49.853802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-75895d17-142e-4571-a8cd-0595b8ed0942 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.345794 May 16 17:07:49.854633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 692/1327] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:49.859537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:49.860636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:49.867759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:49.868215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:49.870187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:49.870645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:50.220465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:50.231755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-73a55a0e-fae5-40b0-b012-7878a2101ae6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.375783 May 16 17:07:50.246751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 693/1328] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:49 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:50.252193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:50.253939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:50.260469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:50.261368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:50.265129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:50.267345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:50.832060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:50.841445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3de01577-552b-4f88-b610-3be3ee200e09 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.592985 May 16 17:07:50.842415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 694/1329] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:50 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:50.871283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:50.873022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:50.879838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:50.880294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:50.881074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:50.881506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:51.141107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:51.156510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe622960-c033-4cad-95bc-8b2430150da4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.289153 May 16 17:07:51.160126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 695/1330] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:51.250950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:51.251841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:51.266935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:51.267677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:51.269634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:51.270417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:51.513883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:51.522280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-afd381af-430f-412d-b575-85184ca42270 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.275675 May 16 17:07:51.526125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 696/1331] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:51 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:51.860205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:51.860839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:51.867093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:51.867555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:51.868326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:51.868767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:52.015598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:52.023513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9843d2a4-c858-4898-80ac-8e605328db8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.167225 May 16 17:07:52.024085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 697/1332] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:51 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:52.175513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:52.176123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:52.185572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:52.186138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:52.186952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:52.187389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:52.345286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:52.352913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab9a00f0-6691-43a7-b168-2f1c414cd342 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.181195 May 16 17:07:52.353509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 698/1333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:52.539500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:52.540116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:52.551652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:52.552038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:52.553125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:52.553629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:52.729525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:52.738889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3002f4ef-eb78-4fb4-b2fc-47892f423ca3 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.203025 May 16 17:07:52.740006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 699/1334] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:52 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:53.043161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:53.044557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:53.054941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:53.055673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:53.056610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:53.057847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:53.231836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:53.241611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-76afef3d-c673-4a2f-b478-dcb26ae9b9e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.204980 May 16 17:07:53.242228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 700/1335] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:53 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:53.370461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:53.371404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:53.378564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:53.379387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:53.380179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:53.380615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:53.609056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:53.620083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cde03689-2e18-4ee8-806d-2804b5853243 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.253643 May 16 17:07:53.621282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 701/1336] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:53.756187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:53.757109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:53.765177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:53.765633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:53.766457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:53.766896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:53.989199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:54.003873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-46986968-8a63-4a8c-be6b-136981fa5927 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.251403 May 16 17:07:54.005223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 702/1337] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:53 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:54.260482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:54.261849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:54.268385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:54.269027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:54.270227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:54.270830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:54.430093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:54.448330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9902c9f9-f76d-482b-a164-37c96db1b5a7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.191124 May 16 17:07:54.454389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 703/1338] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:54 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:54.682189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-e868b3f0-edf1-4622-8b7f-ba3e76a63c09 req-e90cb6c7-175a-4fb7-af89-042b2fa3a364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24443e5c-42e0-4bfb-b5be-c856e1dfd645", "name": "network-vif-plugged", "status": "completed", "tag": "15b82593-cc7e-4a40-a2ba-68178284581c"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:54.696067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e868b3f0-edf1-4622-8b7f-ba3e76a63c09 req-e90cb6c7-175a-4fb7-af89-042b2fa3a364 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:54.696672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e868b3f0-edf1-4622-8b7f-ba3e76a63c09 req-e90cb6c7-175a-4fb7-af89-042b2fa3a364 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:54.725925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-e868b3f0-edf1-4622-8b7f-ba3e76a63c09 req-e90cb6c7-175a-4fb7-af89-042b2fa3a364 service nova] Creating event network-vif-plugged:15b82593-cc7e-4a40-a2ba-68178284581c for instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 on hv-cinder-83998 May 16 17:07:54.732525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-e868b3f0-edf1-4622-8b7f-ba3e76a63c09 req-e90cb6c7-175a-4fb7-af89-042b2fa3a364 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145909 May 16 17:07:54.733768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 704/1339] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:54.739634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:54.740714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:54.753006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:54.756651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:54.757769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:54.758429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:55.013907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:55.022920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a0b42f3a-b376-48e4-9d5f-b11316f03e41 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.287797 May 16 17:07:55.024160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 705/1340] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:55.029783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:55.030720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:55.038254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:55.038884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:55.039767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:55.040307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:55.314825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:55.323555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-72bd1ded-68a2-4757-9917-b878a466598f tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.298134 May 16 17:07:55.324879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 706/1341] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:55 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:55.466600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:55.467533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:55.479636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:55.480239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:55.481207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:55.481795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:55.685392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:55.699250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aba09ac8-8882-4bd9-94d1-25aa01a74fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.237901 May 16 17:07:55.709439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 707/1342] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:55 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:56.040430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:56.041048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:56.047873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:56.048410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:56.049091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:56.049630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:56.198728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:56.206469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f0547c4-7ec5-4f9b-b8a8-0b050e1578ed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.169862 May 16 17:07:56.207041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 708/1343] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:56.341456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:56.342824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:56.359897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:56.360337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:56.361124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:56.362694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:56.516030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:56.523746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-91f56916-855d-4164-894f-34064999ac4c tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1366 microversion: 2.1 time: 0.187179 May 16 17:07:56.524311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 709/1344] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:56 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:56.717981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:56.718874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:56.725483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:56.726107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:56.727007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:56.727556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:56.887666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:56.898090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6c46bf89-2cda-4789-bf2f-b94999127b89 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.185447 May 16 17:07:56.898674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 710/1345] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:56 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:57.225015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:57.226491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:57.240035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.240625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.241506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.242073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.335795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'services' on Instance uuid 38da705b-728f-449a-99ef-1428962695d3 {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:07:57.416240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:57.424718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-96c6f498-7e13-4f60-8947-b7506c1d23f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.204409 May 16 17:07:57.425351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 711/1346] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:57.430094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:57.431333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:57.437458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.437949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.438905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.439347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.474247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a041c8e4-61ae-45c7-a72a-f1b5d6aa4c86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047789 May 16 17:07:57.478120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 712/1347] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:07:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:57.541913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:57.542531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:57.551541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.552844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.554239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.554239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.701028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a6ce9b67564caab0892fc443073202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36b17e1414e208b453d10be94834c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:57.708210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-081e64e3-78bb-450d-925f-659d2e5d5f81 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 200 len: 1557 microversion: 2.1 time: 0.170139 May 16 17:07:57.708779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 713/1348] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:57 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:57.725019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:57.725506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:57.731606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.732055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.732867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.733294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.816479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-174a18f0-6b46-4b6e-8f6f-828ece9ff239 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095188 May 16 17:07:57.817080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 714/1349] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 17:07:57 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:57.915243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:57.916164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:57.922368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.922906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:57.923749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:57.924252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:58.165758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:58.174652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2a925fce-331a-44a2-bdc1-ccaa02b7c246 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.263089 May 16 17:07:58.184795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 715/1350] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:57 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:07:58.442266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:58.443082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:58.449677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:58.450172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:58.450991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:58.451436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:58.710800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:58.725338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c8cae254-0aaf-4a1f-af72-8e08bf84f98e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.287189 May 16 17:07:58.735635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 716/1351] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:58.735635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:58.735635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:58.739060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:58.739501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:58.740286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:58.740725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:58.771933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-18c58738-e6e0-416b-9ed8-43a6dc593300 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 May 16 17:07:58.772692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 717/1352] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:07:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:59.192353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:59.192985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:59.201029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:59.201488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:59.202320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:59.202758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:59.393054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:07:59.401535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-26471d79-5b25-4136-b199-bdd8c97d34d3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.213028 May 16 17:07:59.404829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 718/1353] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:59 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:07:59.418819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-c55cd77e-d740-4c79-ac8d-dd2097821517 req-689170b7-3c3d-47c5-9055-dcfe6a24e5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24443e5c-42e0-4bfb-b5be-c856e1dfd645", "tag": "15b82593-cc7e-4a40-a2ba-68178284581c"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:07:59.427527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-c55cd77e-d740-4c79-ac8d-dd2097821517 req-689170b7-3c3d-47c5-9055-dcfe6a24e5ce service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:59.427964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-c55cd77e-d740-4c79-ac8d-dd2097821517 req-689170b7-3c3d-47c5-9055-dcfe6a24e5ce service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:59.440261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-c55cd77e-d740-4c79-ac8d-dd2097821517 req-689170b7-3c3d-47c5-9055-dcfe6a24e5ce service nova] Creating event network-changed:15b82593-cc7e-4a40-a2ba-68178284581c for instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 on hv-cinder-83998 May 16 17:07:59.445682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-c55cd77e-d740-4c79-ac8d-dd2097821517 req-689170b7-3c3d-47c5-9055-dcfe6a24e5ce service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034044 May 16 17:07:59.449063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 719/1354] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:07:59.752001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:07:59.753115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:07:59.767179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:59.778957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:07:59.780103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:07:59.780752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:00.295504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:00.304103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-055de9d8-8e86-40f6-aa10-6fff77b5e498 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.560655 May 16 17:08:00.315798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 720/1355] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:07:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:00.321903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:00.323250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:00.330633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:00.331384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:00.332382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:00.333049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:00.366785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6143d967-9e3e-4159-9371-54fe829ffaf8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 May 16 17:08:00.370797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 721/1356] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:00.419500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:00.420146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:00.426605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:00.427049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:00.427813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:00.428251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:00.581644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:00.592502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-601e1596-1369-4f42-9460-334431c6e2e3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.177829 May 16 17:08:00.593089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 722/1357] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:00 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:01.322915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:01.323537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:01.330907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:01.331366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:01.332144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:01.332587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:01.474554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:01.483621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0c0a39f3-0667-4949-8374-ba2ef4d3205e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.164468 May 16 17:08:01.484311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 723/1358] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:01.489120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:01.490326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:01.497501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:01.498056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:01.498910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:01.499434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:01.530738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9148ddfc-141a-41b2-8efa-377622d1f3ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 May 16 17:08:01.531252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 724/1359] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:01.610407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:01.611081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:01.617102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:01.617557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:01.618793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:01.619279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:01.758040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:01.766447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fdbf32fa-db6d-477d-8df0-294931f10eb7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.160066 May 16 17:08:01.767026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 725/1360] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:01 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:02.376304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-314a2323-e59a-457e-91f0-40d0c23433fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Action: 'create', calling method: .version_select at 0x7feacd7ee310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-370833792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4p4u7jFWV5D9vh9zVguYg4qRdT/3idTieqI+K2u3BbmmEjxpPVV2GdpDXI3ztcEPjSe93AjcVo75txNNerX5TFv6UtGXSJfrLuJ/nI/5IGuw+SNwT0ZELXCAx3NtQ3Og=="}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:08:02.390454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-314a2323-e59a-457e-91f0-40d0c23433fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Getting quotas for project abf385fc38564b2cad6700769ec328f6. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:08:02.394118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-314a2323-e59a-457e-91f0-40d0c23433fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Getting quotas for user 0af25f69aa4740e5afc8aef142d4f71c and project abf385fc38564b2cad6700769ec328f6. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:08:02.416577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-314a2323-e59a-457e-91f0-40d0c23433fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044016 May 16 17:08:02.417232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 726/1361] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 17:08:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:08:02.467285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1017281352", "imageRef": "def2edf2-5d11-48b5-808d-58824a31ea7d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-370833792", "networks": [{"uuid": "420ded95-9afc-4290-ba0c-08f99b2237f1"}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:08:02.516304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] validate_networks() for [('420ded95-9afc-4290-ba0c-08f99b2237f1', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:08:02.872087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:08:02.872948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:08:02.873518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:08:02.874603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:08:02.876088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:08:02.885409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:02.885884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:02.886677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:02.887104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:02.903415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Getting quotas for project abf385fc38564b2cad6700769ec328f6. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:08:02.907203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Getting quotas for user 0af25f69aa4740e5afc8aef142d4f71c and project abf385fc38564b2cad6700769ec328f6. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:08:02.917633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:08:02.919807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='def2edf2-5d11-48b5-808d-58824a31ea7d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:08:02.963611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3c9fa3d5-9cb3-4496-9bd7-8bc4d91b7801 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499885 May 16 17:08:02.964407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 727/1362] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:08:02.972123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:02.972773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:02.978825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:02.979280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:02.980062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:02.980500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:03.117699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:03.125615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b0fe472b-9c6b-4f7e-8805-f632947e81f1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.160499 May 16 17:08:03.126230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 728/1363] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:03.132255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:03.133387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:03.140454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:03.140911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:03.141765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:03.142213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:03.171660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a7a7d2a4-8e11-4146-977b-6d0059feef62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043442 May 16 17:08:03.172290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 729/1364] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:03.176946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:03.177555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:03.184024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:03.184614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:03.185252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:03.185681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:03.320457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:03.328962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-82b2977e-03b6-4318-ab1c-20116aa9d740 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.155698 May 16 17:08:03.329626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 730/1365] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:03 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:03.334990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bb36dae9-a208-43d6-abe0-c0554ec4fc62 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:03.335600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bb36dae9-a208-43d6-abe0-c0554ec4fc62 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:03.391461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bb36dae9-a208-43d6-abe0-c0554ec4fc62 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:03.398348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bb36dae9-a208-43d6-abe0-c0554ec4fc62 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1258 microversion: 2.1 time: 0.067660 May 16 17:08:03.398914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 731/1366] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:03 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:04.143663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:04.144357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:04.150290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.150836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.151635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.152074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.376766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:04.403112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-12d819d1-6694-4041-a5a0-1a65a8d78af0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.247613 May 16 17:08:04.417484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 732/1367] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:04.437658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:04.441111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:04.448237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.449248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.450344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.451183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.488246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce0dbbae-df9b-4e6d-8f7e-2c2016de1412 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066150 May 16 17:08:04.489683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 733/1368] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:04.497649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:04.498953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:04.506325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.507218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.508731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.509473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.739685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:04.752185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-02d4006b-adb7-4bef-b4fa-248c60784045 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.257080 May 16 17:08:04.753369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 734/1369] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:04 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:04.763279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:04.764141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:04.780026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.780766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:04.781732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:04.782469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.095102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:05.103138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-12d8d5b0-f164-4311-abf9-e8cafe77e078 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.348341 May 16 17:08:05.103991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 735/1370] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:04 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:05.423067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:05.423786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:05.430222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:05.430736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.432080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:05.432531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.571707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:05.580618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e6b8540b-dbb6-4087-90be-e0949e30d61c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.161536 May 16 17:08:05.586635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 736/1371] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:05.592118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:05.593233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:05.601314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:05.601811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.602602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:05.603041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.643386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8a588571-617e-40ca-86af-c2b0a52412d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055752 May 16 17:08:05.647526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 737/1372] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:05.769855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:05.771309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:05.776976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:05.777436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.778253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:05.778694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:05.914649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:05.923397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da885a35-2c53-4510-b91b-1c733563738e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.157535 May 16 17:08:05.924105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 738/1373] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:05 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:06.122057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:06.122855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:06.128967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.129486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.130357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.130856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.311131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:06.318661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fabe8de4-fc08-4343-8587-6979c6d984c8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.201638 May 16 17:08:06.319291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 739/1374] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:06 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:06.603736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:06.605861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:06.612719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.613259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.614148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.614647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.753581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:06.762467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1858a6d1-7554-4db3-b977-830d55adefb1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.162604 May 16 17:08:06.772109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 740/1375] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:06.777686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:06.778692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:06.784811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.785257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.786064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.786496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.816962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9621de74-d2fe-45dd-a244-b5b3c66bed40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 May 16 17:08:06.817501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 741/1376] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:06.941051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:06.941873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:06.947965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.948496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:06.949370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:06.949907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.108343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:07.116814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-66ccc434-16d4-4b49-8262-9bf8b8779f6a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.179891 May 16 17:08:07.117586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 742/1377] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:06 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:07.335605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:07.336326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:07.343601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:07.344045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.344818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:07.345276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.486102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:07.493921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-889c3874-fae3-44db-910f-3c23506e3af3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.162208 May 16 17:08:07.495426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 743/1378] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:07 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:07.779355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:07.780041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:07.786445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:07.786897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.787752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:07.788272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.923751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:07.935462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-906f206f-3481-4a14-b4ea-91c18c169976 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.156224 May 16 17:08:07.935462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 744/1379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:07.939046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:07.940303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:07.949052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:07.949509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.950334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:07.950774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:07.983223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bf9b9810-5fde-46a7-8f9e-3eb25e8a9a2e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 May 16 17:08:07.985770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 745/1380] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:08.133843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:08.134768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:08.141311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:08.141899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:08.142692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:08.143129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:08.279321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:08.287792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d5ec5181-0722-4146-838e-9287cf828a86 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.157785 May 16 17:08:08.288373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 746/1381] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:08 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:08.511204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:08.512000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:08.518599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:08.519053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:08.519834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:08.520265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:08.653103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:08.660647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9ba01577-3b86-44bc-b65b-f28026ccc172 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.153377 May 16 17:08:08.661215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 747/1382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:08 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:08.952473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:08.953187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:08.959376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:08.959818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:08.960582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:08.961007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.103299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:09.110544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c57adb3b-6367-4f6f-9bfa-e9842ff50c50 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.161998 May 16 17:08:09.111111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 748/1383] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:09.115538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:09.116522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:09.123925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:09.124376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.125151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:09.125582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.156593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2363a3c9-5b54-495e-8e40-d5190e562a95 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 May 16 17:08:09.157463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 749/1384] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:09.309278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:09.309278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:09.317966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:09.318565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.319523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:09.319961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.455501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:09.463651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-53cdec80-3a96-4377-bc16-7d692fe9c38a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.161862 May 16 17:08:09.464221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 750/1385] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:09 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:09.678275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:09.678904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:09.686458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:09.686903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.687662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:09.688092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:09.821266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:09.829254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e8909276-6fc1-4d41-9404-1f12dc7f94e3 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.154793 May 16 17:08:09.832849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 751/1386] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:09 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:10.128182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:10.129064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:10.135294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.135887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.136660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.137089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.280434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:10.287781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-28ad3a22-af62-4c10-98a4-afd4a74413b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.163504 May 16 17:08:10.288348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 752/1387] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:10.293793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:10.294755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:10.300464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.300905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.301660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.302138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.333700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b13b987-02c1-4588-b4ef-62e715074797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 May 16 17:08:10.334508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 753/1388] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:10.480401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:10.481035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:10.487003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.487448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.488212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.488641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.633049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:10.644849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2ba4f01d-9ad3-4766-ade4-75d9320019c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.168255 May 16 17:08:10.645358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 754/1389] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:10 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:10.846285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:10.846899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:10.852837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.853387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:10.854205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:10.854651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.039894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:11.047746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f194279b-fa8d-4d97-a6ee-129657f0b5fb tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.205225 May 16 17:08:11.053855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 755/1390] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:10 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:11.305428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:11.306222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:11.313287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:11.313767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.314528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:11.314956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.464316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:11.472537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-63b9468f-5485-40a9-ab5f-8e4fb4cd369e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.171309 May 16 17:08:11.473115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 756/1391] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:11.477802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:11.478833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:11.484677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:11.485131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.485921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:11.486363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.517065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3ab2a3f8-7f40-4f50-a936-7583a0159ada tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 May 16 17:08:11.517784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 757/1392] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:11.662082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:11.662693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:11.669322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:11.669799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.670586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:11.671041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:11.808375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:11.816613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-418357cb-a0df-4598-98c4-107487cb139c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.158397 May 16 17:08:11.822041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 758/1393] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:11 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:12.064508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:12.065136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:12.071248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.071700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.072548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.073509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.199746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:12.206871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d8439036-3597-4a32-ab38-cca3eeb5e97c tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.146221 May 16 17:08:12.207434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 759/1394] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:12 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:12.491157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:12.491860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:12.498966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.499416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.500261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.500692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.711322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:12.719024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e19afbdf-7319-4e34-8927-1c8f6d72e516 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.231729 May 16 17:08:12.719614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 760/1395] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:12.724596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:12.725548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:12.731759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.732270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.733202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.733668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.762612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7c631071-488f-4df8-8f8d-3d5812ba7bf1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041818 May 16 17:08:12.763183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 761/1396] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:12.834265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:12.834876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:12.841333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.841797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:12.842560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:12.842989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.052073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:13.065560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-af046536-ee3f-41ad-b92e-bc380dbaf527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.234738 May 16 17:08:13.074783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 762/1397] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:12 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:13.225052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:13.225846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:13.235471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.235958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.236966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.237241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.462058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:13.470436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da52f589-a95a-4174-a28b-23d856eca2a1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.249485 May 16 17:08:13.470976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 763/1398] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:13 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:13.475356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-34583052-5732-415f-923c-6800e8a90b41 req-c19d4707-9f2c-407b-8203-1cdd188e31bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a481b1-1446-43c5-a0ab-6ef3b8cf6778", "tag": "ec76dccb-ed65-492d-b8a5-3e61430c1e71"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:08:13.483076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-34583052-5732-415f-923c-6800e8a90b41 req-c19d4707-9f2c-407b-8203-1cdd188e31bd service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.483520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-34583052-5732-415f-923c-6800e8a90b41 req-c19d4707-9f2c-407b-8203-1cdd188e31bd service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.494268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-34583052-5732-415f-923c-6800e8a90b41 req-c19d4707-9f2c-407b-8203-1cdd188e31bd service nova] Creating event network-changed:ec76dccb-ed65-492d-b8a5-3e61430c1e71 for instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 on hv-cinder-83998 May 16 17:08:13.499279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-34583052-5732-415f-923c-6800e8a90b41 req-c19d4707-9f2c-407b-8203-1cdd188e31bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027165 May 16 17:08:13.499884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 764/1399] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:13.735757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:13.736375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:13.742592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.743047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.743821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.744777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.870196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:13.877355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-56b38a27-212f-4858-ae87-70ece704b74f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.145933 May 16 17:08:13.877949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 765/1400] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:13.882503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:13.883447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:13.889528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.890003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.890756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:13.891188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:13.919350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-159f2455-7984-4c5a-91ee-c1177bb88a7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040436 May 16 17:08:13.919899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 766/1401] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:14.082273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:14.082923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:14.088916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:14.089372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:14.090175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:14.090619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:14.215125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:14.223020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c1464b96-e176-41c5-9460-6790ed18b590 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144712 May 16 17:08:14.223600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 767/1402] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:14 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:14.487258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:14.487906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:14.493865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:14.494315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:14.495073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:14.495508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:14.618785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:14.625901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1188062f-6d00-448c-b0e4-9c048ce6ced7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.142667 May 16 17:08:14.626471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 768/1403] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:14 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:14.895174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:14.895786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:14.901591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:14.902089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:14.902832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:14.903262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.108867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:15.116097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ec603687-4d9f-4ddf-bda5-e61a0eab0a8f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.224704 May 16 17:08:15.116671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 769/1404] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:15.121344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:15.122366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:15.128012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:15.128459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.129229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:15.129660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.158334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-56994e8e-3ea8-4506-8889-a5609848e7a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040650 May 16 17:08:15.158899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 770/1405] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:15.241326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:15.241960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:15.247753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:15.248201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.248965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:15.249399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.603717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:15.613157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5b231b47-bd18-4111-a4ab-e3d2d74bdc9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.376312 May 16 17:08:15.613769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 771/1406] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:15 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:15.641784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:15.642426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:15.648926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:15.649371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.650176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:15.651264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:15.773079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:15.780804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-882bbcfa-dfad-441b-bdc2-553734338d39 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.142838 May 16 17:08:15.781363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 772/1407] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:15 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:16.132574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:16.133177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:16.139673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.140127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.140880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.141311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.270462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:16.279305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d33013ae-621b-4cb5-8fdf-1aa1399e6e1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.150529 May 16 17:08:16.279884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 773/1408] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:16.284519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:16.285488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:16.291717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.292139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.292895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.293327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.324469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-66985301-7b4d-4239-900e-3549f5b39355 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 May 16 17:08:16.324469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 774/1409] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:16.635035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:16.635813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:16.641988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.642431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.643189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.643620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.769369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:16.777599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ef06de75-ebc9-4556-a495-f50f004cb7b2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146598 May 16 17:08:16.778220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 775/1410] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:16 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:16.797595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:16.798226 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:16.803930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.804367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.805116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:16.805542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:16.933121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:16.940443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c29ecdb8-fd73-4b06-b28e-12b7427036b4 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.146426 May 16 17:08:16.941013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 776/1411] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:16 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:17.296373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:17.296984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:17.302889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.303337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.304096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.304528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.429586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:17.437391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-89c75cf7-cf17-4779-8151-a97bbb624281 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.144882 May 16 17:08:17.437990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 777/1412] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:17.442463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:17.443418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:17.450054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.450512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.451317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.451777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.479902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b051592a-4b8b-4a14-951c-88ce9cf87e9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040942 May 16 17:08:17.480460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 778/1413] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:17.794654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:17.795326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:17.801494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.801978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.802741 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.803178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.929880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:17.937593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f290af02-4858-4953-9a6b-af60b6e2fbe1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146692 May 16 17:08:17.938206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 779/1414] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:17 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:17.959733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:17.960340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:17.966926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.967393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:17.968149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:17.968578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.090170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:18.098375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e6aa9cb0-64e4-432c-8c6e-96e00afee554 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.142089 May 16 17:08:18.098950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 780/1415] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:17 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:18.245609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-bb08298b-667e-4892-a48b-192a564f05bd req-f70c02fe-5876-452f-9d39-dc6c7f8f428a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a481b1-1446-43c5-a0ab-6ef3b8cf6778", "name": "network-vif-plugged", "status": "completed", "tag": "ec76dccb-ed65-492d-b8a5-3e61430c1e71"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:08:18.253631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-bb08298b-667e-4892-a48b-192a564f05bd req-f70c02fe-5876-452f-9d39-dc6c7f8f428a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.254148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-bb08298b-667e-4892-a48b-192a564f05bd req-f70c02fe-5876-452f-9d39-dc6c7f8f428a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.267366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-bb08298b-667e-4892-a48b-192a564f05bd req-f70c02fe-5876-452f-9d39-dc6c7f8f428a service nova] Creating event network-vif-plugged:ec76dccb-ed65-492d-b8a5-3e61430c1e71 for instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 on hv-cinder-83998 May 16 17:08:18.272451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-bb08298b-667e-4892-a48b-192a564f05bd req-f70c02fe-5876-452f-9d39-dc6c7f8f428a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031179 May 16 17:08:18.273076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 781/1416] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:08:18.454952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:18.455773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:18.461930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.462380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.463146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.463580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.608801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:18.616024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6b1a4078-5e85-49c8-a219-5bdfc8215faf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.165397 May 16 17:08:18.616596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 782/1417] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:18.621613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:18.622580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:18.628192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.628635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.629384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.629848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.659529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6c4b148c-2291-48f5-8950-1f3e45012134 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 May 16 17:08:18.660065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 783/1418] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:18.956186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:18.956791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:18.963634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.964100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:18.964845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:18.965277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.089082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:19.096980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-865273f3-bf8e-4485-a084-9c3108c69108 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145768 May 16 17:08:19.097537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 784/1419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:18 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:19.114432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:19.115096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:19.121044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:19.121497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.122265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:19.122694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.251098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:19.258357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-59776925-35c1-4418-b058-eda19f7a28f7 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1358 microversion: 2.1 time: 0.147389 May 16 17:08:19.258932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 785/1420] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:19 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:19.633662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:19.634385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:19.640640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:19.641080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.641876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:19.642563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.773585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:19.781470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-857ca078-6924-4b5f-9fb6-5507500a9d3a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.151943 May 16 17:08:19.782077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 786/1421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:19.786570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:19.787553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:19.793618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:19.794097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.794857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:19.795297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:19.822904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e46ccd2d-7185-4f70-8d21-bf428e48f7d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039830 May 16 17:08:19.823447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 787/1422] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:20.113816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:20.114472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:20.120761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.121203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.121989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.122419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.250802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:20.258792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9ca90714-7204-4248-9a01-269b7726b99b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148819 May 16 17:08:20.259363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 788/1423] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:20 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:20.274561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:20.275161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:20.281350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.281825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.282579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.283006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.410128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:20.417452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2d07b352-9435-43a3-b2ea-90face621255 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1549 microversion: 2.1 time: 0.146519 May 16 17:08:20.418044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 789/1424] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:20 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:20.433447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:20.434088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:20.439784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.440231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.440997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.441436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.564752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:20.572072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-65da7176-8f58-4084-b245-40f66bfb04af tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1549 microversion: 2.1 time: 0.142762 May 16 17:08:20.573212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 790/1425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:20 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1549 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:20.587698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:20.591419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:20.592080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Searching by: {'deleted': False, 'project_id': 'abf385fc38564b2cad6700769ec328f6'} {{(pid=117184) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 17:08:20.598579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.599024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.599823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.600258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.688001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.multi_cell_list [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117184) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 17:08:20.776398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5f223316-c550-49e2-834e-1d38da763db1 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.192051 May 16 17:08:20.776990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 791/1426] 10.222.0.70 () {58 vars in 1124 bytes} [Mon May 16 17:08:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:08:20.786734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:20.787339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:20.793445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.793940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.794704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.795141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.921667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af25f69aa4740e5afc8aef142d4f71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf385fc38564b2cad6700769ec328f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:20.928846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ba3aa281-ddca-4354-b897-d76391fcad7e tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 200 len: 1549 microversion: 2.1 time: 0.145647 May 16 17:08:20.929416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 792/1427] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:20 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:20.937161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:20.937161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:20.940477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.940863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:20.941631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:20.942083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:21.072499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:21.079783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-75a79311-6a0f-40d4-97cc-32b414cb0a5c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149421 May 16 17:08:21.080344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 793/1428] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:21.084740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:21.085642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:21.091773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:21.092215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:21.092962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:21.093390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:21.124572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0276d12f-4bba-4737-a9b3-cf43e8a48dca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 May 16 17:08:21.125227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 794/1429] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:21.276278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:21.276811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:21.282584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:21.283026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:21.283779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:21.284206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:21.410366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:21.418783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-797eed88-840b-437e-82b5-19c4fb43ba4a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146700 May 16 17:08:21.419353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 795/1430] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:21 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:22.097591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:22.098239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:22.104108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:22.104552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:22.105301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:22.105729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:22.231228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:22.238466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b30fc888-f2fb-4bce-96b7-c703c1f58c88 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.144745 May 16 17:08:22.239058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 796/1431] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:22.243449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:22.244929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:22.250759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:22.251204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:22.251973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:22.253102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:22.280822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-114759e7-f6d1-4c22-86c2-8d74782a8b8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040799 May 16 17:08:22.281369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 797/1432] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:22.436272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:22.436874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:22.443012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:22.443460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:22.444214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:22.444637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:22.570429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:22.578435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-28741875-7ade-4028-9aac-efc520119499 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146530 May 16 17:08:22.579004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 798/1433] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:22 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:23.256584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:23.257237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:23.264029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:23.264486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:23.265258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:23.265685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:23.398070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:23.405331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4977006d-cb97-4011-af0d-d025a61cfd49 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.152777 May 16 17:08:23.405927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 799/1434] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:23.410575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:23.411417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:23.417286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:23.417756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:23.418540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:23.418984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:23.448129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1f15bb18-cad3-4e58-bf56-3792ba8eb70c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040643 May 16 17:08:23.448701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 800/1435] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:23.595479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:23.596087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:23.601968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:23.602420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:23.603180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:23.603614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:23.725714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:23.733983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f1202a2b-ab7a-483f-9637-20a46cc92dcb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.142278 May 16 17:08:23.734554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 801/1436] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:23 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:24.422863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:24.423457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:24.429665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:24.430211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:24.430961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:24.431395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:24.564328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:24.574910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dda38716-7ae3-4f62-85e7-11ccac6c7eef tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.155600 May 16 17:08:24.575482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 802/1437] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:24.581422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:24.582373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:24.588273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:24.588719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:24.589479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:24.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:24.618065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cf1a55ec-907c-4f5d-bec9-7d362c5b2c99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 May 16 17:08:24.618620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 803/1438] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:24.751282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:24.751856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:24.757527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:24.758010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:24.758771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:24.759206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:24.881323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:24.889029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ac0c0108-5ed4-4a3a-bf9e-af2f65aed399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.141500 May 16 17:08:24.889599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 804/1439] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:24 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:25.592658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:25.593314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:25.599542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:25.599991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:25.600779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:25.601213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:25.725511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:25.733590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4bcb0cd2-1907-43a3-b827-11ee61a7f6cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.145640 May 16 17:08:25.734192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 805/1440] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:25.738665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:25.739556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:25.744907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:25.745348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:25.746192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:25.746676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:25.773807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33dd0b17-7170-415b-99e7-3a935d77375b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038641 May 16 17:08:25.774343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 806/1441] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:25.906029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:25.906627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:25.912194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:25.912635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:25.913372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:25.913829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:26.043346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:26.051008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a627208b-f1a7-462f-8da3-a55b34ee3ad7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149353 May 16 17:08:26.051568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 807/1442] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:25 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:26.751677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:26.752287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:26.758536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:26.758981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:26.759859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:26.760358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:26.887066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:26.894367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1486e61c-12cb-4cec-9707-7d40f9e42d99 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.146558 May 16 17:08:26.895153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 808/1443] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:08:26.899456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:26.900361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:26.906249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:26.906761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:26.907536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:26.907974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:26.936683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8bd11742-822f-4d53-b2da-20d8f329c331 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 May 16 17:08:26.937237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 809/1444] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:27.067998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:27.068531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:27.076348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:27.076807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:27.078080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:27.078657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:27.205606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:27.213229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8ee186ec-db80-4c16-9600-7e5e845c79c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149306 May 16 17:08:27.213816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 810/1445] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:27 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:27.911751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:27.912406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:27.919211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:27.919649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:27.920403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:27.920831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:28.048242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:28.055594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-12af75e5-07d5-484f-bcd3-909182b351c1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147677 May 16 17:08:28.056161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 811/1446] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:28.060674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:28.061602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:28.066972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:28.067422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:28.068183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:28.068618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:28.096700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a13c3a42-19e0-4d76-92f5-cb8938a50f8a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039568 May 16 17:08:28.097242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 812/1447] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:28.230736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:28.231267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:28.237043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:28.237491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:28.238288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:28.238725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:28.368717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:28.376375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-06f05aa6-5735-4450-9be8-79dabf990a5f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149420 May 16 17:08:28.376938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 813/1448] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:28 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:29.072366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:29.073040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:29.079248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:29.079690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:29.080443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:29.080871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:29.210575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:29.218022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-12d115b8-644a-4946-b8d5-7bc3abf372a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149490 May 16 17:08:29.218581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 814/1449] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:29.223160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:29.224047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:29.229350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:29.229851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:29.231131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:29.231564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:29.258869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-caf5bdca-69ce-4141-b61a-76b096d488ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039337 May 16 17:08:29.259409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 815/1450] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:29.393147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:29.393775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:29.399710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:29.400158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:29.400919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:29.401350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:29.525129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:29.533289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9dbb1578-9795-4fee-95bb-8dbf8695933f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144032 May 16 17:08:29.533867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 816/1451] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:29 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:30.235009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:30.235740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:30.242260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:30.242704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:30.243458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:30.243885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:30.374797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:30.382039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9539c6f7-9d34-48b9-b4a8-a7c415d7bd6d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.150946 May 16 17:08:30.382606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 817/1452] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:30.387734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:30.388630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:30.394082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:30.394531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:30.395289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:30.395726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:30.423829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3f1bf9c6-41c3-4dd8-a056-569b0901f3ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040195 May 16 17:08:30.424996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 818/1453] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:30.551263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:30.551809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:30.557616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:30.558112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:30.559496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:30.559934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:30.683072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:30.691337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9608e10e-0123-4dfb-869c-0776c8486f1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143961 May 16 17:08:30.691909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 819/1454] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:30 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:31.400803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:31.401530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:31.408360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:31.408797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:31.409554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:31.410014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:31.540051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:31.547835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e23e8572-2905-4299-89ac-2624647693da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.150858 May 16 17:08:31.548397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 820/1455] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:31.552914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:31.553849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:31.559096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:31.559536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:31.560285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:31.560721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:31.588320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aaa07c10-80ee-499a-95ae-c412aa0cea9c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038952 May 16 17:08:31.588879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 821/1456] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:31.707928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:31.708459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:31.714571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:31.715059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:31.716060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:31.716499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:31.840366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:31.848207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-950bd6a6-a0c1-42a7-b394-db2d5082ceab tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144182 May 16 17:08:31.848768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 822/1457] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:31 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:32.563997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:32.564682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:32.570843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:32.571292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:32.572047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:32.572478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:32.699808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:32.707098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-71ea79a3-0f19-462c-be64-72a3c83eea58 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147070 May 16 17:08:32.707663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 823/1458] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:32.712073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:32.712965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:32.719248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:32.719695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:32.720448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:32.720882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:32.748957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e009733b-b2fa-47d5-b8f4-b929eb5d5b57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040334 May 16 17:08:32.749506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 824/1459] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:32.864552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:32.865149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:32.870749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:32.871784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:32.872532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:32.872957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:32.999785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:33.009138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a04aca5b-66b9-4719-9eca-079581bed236 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148228 May 16 17:08:33.009749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 825/1460] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:32 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:33.725039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:33.725680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:33.732454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:33.732905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:33.733667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:33.734130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:33.859963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:33.867283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6fb09963-69a1-4b33-9844-08d150d49f32 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.146183 May 16 17:08:33.867851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 826/1461] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:33.872285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:33.873204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:33.878639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:33.879087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:33.879847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:33.880281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:33.908026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-829b7e86-aef1-4668-b08e-89285572dbb1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039209 May 16 17:08:33.908573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 827/1462] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:34.025856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:34.026396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:34.032076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:34.032522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:34.033268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:34.033694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:34.160869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:34.168545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7fce660d-d9c5-448e-9a65-02a7c9b8f48e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146300 May 16 17:08:34.169121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 828/1463] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:34 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:34.884204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:34.884878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:34.891631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:34.892071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:34.892826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:34.893255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.020669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:35.028769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-897aa851-2ac8-45fa-861f-d75841bbaabb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.148401 May 16 17:08:35.029334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 829/1464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:35.033959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:35.034855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:35.040187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:35.040634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.041399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:35.041864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.069898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-459d2baf-fb0d-47ee-924b-27bcae687504 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039365 May 16 17:08:35.070338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 830/1465] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:35 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:35.146418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:35.146841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:35.153438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:35.153913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.154683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:35.155120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.177415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a4c7017a-3927-47fc-9c93-2e9ae26b3381 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645/ips" status: 200 len: 150 microversion: 2.1 time: 0.034869 May 16 17:08:35.178027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 831/1466] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:08:35 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:08:35.306328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:35.306947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:35.313219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:35.313665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.314457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:35.314891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:35.442214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:35.450973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d14971f-531f-4761-8b72-6b48bc65bac2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.270367 May 16 17:08:35.451598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 832/1467] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:35 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:36.046403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:36.047089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:36.053458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:36.053962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:36.054790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:36.055135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:36.181841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:36.189010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83c17faa-07dc-473f-8263-9a0e92ea6e04 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147106 May 16 17:08:36.189567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 833/1468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:36.194056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:36.195022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:36.200371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:36.200831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:36.201563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:36.202027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:36.229844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f401ee1b-935e-45b3-8557-934442642a7c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039271 May 16 17:08:36.231024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 834/1469] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:36.468856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:36.469467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:36.475386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:36.475835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:36.476603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:36.477038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:36.600044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:36.607706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a6202d89-6823-42f0-b99f-182d9a29084a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143586 May 16 17:08:36.608271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 835/1470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:36 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:37.205972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:37.206613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:37.212734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.213177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.213977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.214412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.343849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:37.351056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8d67b454-610a-4f9e-8b87-1ffc50e24b48 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149032 May 16 17:08:37.351632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 836/1471] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:37.356166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:37.357593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:37.362958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.363405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.364167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.364603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.392880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-87811793-6ed2-4d3c-93fe-4cf700ecb9d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040234 May 16 17:08:37.393441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 837/1472] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:08:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:08:37.625095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:37.625704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:37.631582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.632030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.632793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.633228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.760045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:08:37.768452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-01fb9b45-d2f8-46b4-91b8-16cbc88b19d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147136 May 16 17:08:37.769027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 838/1473] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:08:37 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:08:37.773655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:08:37.774193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:08:37.779647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.780092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:08:37.780880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:08:37.781319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.035827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3a78cf66-96e7-4ec3-a741-eca5f060720e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc" status: 202 len: 0 microversion: 2.1 time: 120.326035 May 16 17:09:38.036610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 636/1474] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:07:37 2022] DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc => generated 0 bytes in 120328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:09:38.042258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:38.042984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:38.049178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.049900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.050961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.051379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.187659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:09:38.195012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1a229d14-84b6-4d38-b587-9967bec036dc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.157305 May 16 17:09:38.195582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 637/1475] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:09:38.200470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:38.202128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:38.208840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.209602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.210689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.211503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.249511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c9b46f4f-79c7-4a88-9415-53ab458234b8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052737 May 16 17:09:38.250103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 638/1476] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:09:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:09:38.254435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:38.255037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:38.260637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.261087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.261888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.262323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.405733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:09:38.414975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-635bc88e-22c1-4a5d-a4f8-75ed2c97a774 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.163861 May 16 17:09:38.415598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 639/1477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:38 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:09:38.429683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:38.430475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:38.437278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.437730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.438583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.439062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.464900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:09:38.548251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0c93551-4aa1-429f-9730-ed42d8ca69f6 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 204 len: 0 microversion: 2.1 time: 0.122024 May 16 17:09:38.548895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 640/1478] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:09:38 2022] DELETE /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:09:38.555140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:38.555490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:38.562531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.563010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.563937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.564229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.586504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'services' on Instance uuid 38da705b-728f-449a-99ef-1428962695d3 {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:09:38.592976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:09:38.676467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e5b56261-97a7-4c55-bfd4-e056e4debac6 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 204 len: 0 microversion: 2.1 time: 0.125455 May 16 17:09:38.677090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 641/1479] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:09:38 2022] DELETE /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:09:38.682841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:38.683420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:38.689618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.690113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:38.690880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:38.691315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.459065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Request method failure captured: May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc HTTP/1.1 May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoLEX0V3p-2_bGNdQv5uW6avMJDBGpBvNKnAWV3tcqSSgh_cr9EWrcg5uUMy1yyKL6EMa1TS4dEcPXMLsl0ZRLHN6P5H7bZ4qVzLIB9_rVFykzoWXE-IjNT-BcgPctnTOPRbyapbT_W6W4ZGQL5Fmt1QfbzUPwaTBqNe-bR7q8b3RS8 May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: e07bcaeeb617491689c13594914b370e May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:09:57.461446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e07bcaeeb617491689c13594914b370e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e07bcaeeb617491689c13594914b370e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: e07bcaeeb617491689c13594914b370e May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 3ab541e9017c4ece9432f1fedde0f64e May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:09:57.463083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'server_id': '38da705b-728f-449a-99ef-1428962695d3', 'id': 'caece44f-fa74-47ca-b9b2-3328236ee4dc'} May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:09:57.464095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:09:57.465204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.466661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:57.467643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) May 16 17:09:57.468753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.471420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f76be5ce-3479-4845-85cd-01bdf0492483) {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:09:57.471420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3d847ced-5205-4e0e-b3ab-57664cb9ded4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc" status: 400 len: 269 microversion: 2.1 time: 79.692919 May 16 17:09:57.471420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 839/1480] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:08:37 2022] DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc => generated 269 bytes in 79694 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:09:57.471420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:57.471999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] [instance: 84a481b1-1446-43c5-a0ab-6ef3b8cf6778] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:57.477111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.477563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.478375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.478810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.492614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] HTTP exception thrown: Instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 could not be found. May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Request method failure captured: May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 HTTP/1.1 May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoThTw6cSPrcYs20ozI7INqD43FayiObmWS-J2At_GAhYWFsC7Z-Y7fhbbkHBe-YiP7rLZGJVo6mb9zXyFjWVQvPYvtwMbXolNZY8HeRf9kdzmt2kHCW9PtOPPVTxgR82HRdQZSkFDOx6AJp1hLT1B52adIatXCgl8CbLkszCpw_mmU May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: abf385fc38564b2cad6700769ec328f6 May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-TestMinimumBasicScenario-1672040623 May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:09:57.494189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abf385fc38564b2cad6700769ec328f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abf385fc38564b2cad6700769ec328f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abf385fc38564b2cad6700769ec328f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abf385fc38564b2cad6700769ec328f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-TestMinimumBasicScenario-1672040623 May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: abf385fc38564b2cad6700769ec328f6 May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1672040623 May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-TestMinimumBasicScenario-1672040623-project May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 0af25f69aa4740e5afc8aef142d4f71c May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-TestMinimumBasicScenario-1672040623-project May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 could not be found. May 16 17:09:57.495503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '84a481b1-1446-43c5-a0ab-6ef3b8cf6778'} May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 could not be found. May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:09:57.496298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 could not be found. May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 could not be found. May 16 17:09:57.497513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.498658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Returning 404 to user: Instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:09:57.498658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab809340-6229-4ad1-b17d-8175eea73206 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778" status: 404 len: 111 microversion: 2.1 time: 0.030710 May 16 17:09:57.498658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 840/1481] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:57 2022] GET /compute/v2.1/servers/84a481b1-1446-43c5-a0ab-6ef3b8cf6778 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:09:57.500876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:57.501490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:57.509622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.510086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.510851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.511294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.513310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'services' on Instance uuid 38da705b-728f-449a-99ef-1428962695d3 {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:09:57.525772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 HTTP/1.1 May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:09:57.527297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:57.528573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '24443e5c-42e0-4bfb-b5be-c856e1dfd645'} May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:09:57.529289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:57.530663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:57.531735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:09:57.531735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab56e39f-ab19-416c-b2e6-7d4bc1791c87 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 404 len: 111 microversion: 2.1 time: 0.031669 May 16 17:09:57.531735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 841/1482] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:57 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:09:57.535117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:57.535738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:57.541704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.542194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.542975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.543412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.690015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:09:57.697822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aa6077e2-5c97-4be1-9d3a-8d1612c6c8e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.167100 May 16 17:09:57.698423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 842/1483] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:09:57.703461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:57.704479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:57.711512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.711964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.712825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.713286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.743972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b2796190-039f-43aa-8bda-83e7c5932ab5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 May 16 17:09:57.744544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 843/1484] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:09:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:09:57.748915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:57.749509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:57.756853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.757372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.758464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.758901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.907392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:09:57.925169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7855b83a-1d7b-4dbf-9925-7a02847ef122 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.179587 May 16 17:09:57.925782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 844/1485] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:57 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:09:57.930284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-67b6c6e0-c493-4a46-8841-c5ee35b15a34 req-ced61283-81cb-4b95-8120-e4a53a51cdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a481b1-1446-43c5-a0ab-6ef3b8cf6778", "name": "network-vif-deleted", "tag": "ec76dccb-ed65-492d-b8a5-3e61430c1e71"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:09:57.938713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-67b6c6e0-c493-4a46-8841-c5ee35b15a34 req-ced61283-81cb-4b95-8120-e4a53a51cdae service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.939085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-67b6c6e0-c493-4a46-8841-c5ee35b15a34 req-ced61283-81cb-4b95-8120-e4a53a51cdae service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.951150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-67b6c6e0-c493-4a46-8841-c5ee35b15a34 req-ced61283-81cb-4b95-8120-e4a53a51cdae service nova] Creating event network-vif-deleted:ec76dccb-ed65-492d-b8a5-3e61430c1e71 for instance 84a481b1-1446-43c5-a0ab-6ef3b8cf6778 on hv-cinder-83998 May 16 17:09:57.956651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-67b6c6e0-c493-4a46-8841-c5ee35b15a34 req-ced61283-81cb-4b95-8120-e4a53a51cdae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029716 May 16 17:09:57.957254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 845/1486] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:09:57.962673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-a9a07110-213d-48b7-be27-169b0670a460 req-440f50fa-9842-4523-aa36-30efdebd2990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24443e5c-42e0-4bfb-b5be-c856e1dfd645", "name": "network-vif-deleted", "tag": "15b82593-cc7e-4a40-a2ba-68178284581c"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:09:57.971499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a9a07110-213d-48b7-be27-169b0670a460 req-440f50fa-9842-4523-aa36-30efdebd2990 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:57.971942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a9a07110-213d-48b7-be27-169b0670a460 req-440f50fa-9842-4523-aa36-30efdebd2990 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:57.983362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-a9a07110-213d-48b7-be27-169b0670a460 req-440f50fa-9842-4523-aa36-30efdebd2990 service nova] Creating event network-vif-deleted:15b82593-cc7e-4a40-a2ba-68178284581c for instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 on hv-cinder-83998 May 16 17:09:57.988625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-a9a07110-213d-48b7-be27-169b0670a460 req-440f50fa-9842-4523-aa36-30efdebd2990 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030023 May 16 17:09:57.989215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 846/1487] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:09:57.994488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-69f79b3d-b16a-40af-a0c9-5f47185adfe8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] Calling method '.version_select at 0x7feacf6704c0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:58.012581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-69f79b3d-b16a-40af-a0c9-5f47185adfe8 tempest-TestMinimumBasicScenario-1672040623 tempest-TestMinimumBasicScenario-1672040623-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-370833792" status: 202 len: 0 microversion: 2.1 time: 0.022158 May 16 17:09:58.013148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 847/1488] 10.222.0.70 () {58 vars in 1268 bytes} [Mon May 16 17:09:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-370833792 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:09:58.018279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b58225f2-1720-4eb2-bb55-e15a4c171edb tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '.version_select at 0x7feacd8c6940>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:58.035220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b58225f2-1720-4eb2-bb55-e15a4c171edb tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811913824" status: 202 len: 0 microversion: 2.1 time: 0.021071 May 16 17:09:58.035828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 848/1489] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 16 17:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811913824 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:09:58.515585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:09:58.516343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc (ip 10.222.0.70) !!! May 16 17:09:58.725254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:58.725254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:58.732555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:58.733007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:58.733837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:58.734253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.066623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:09:59.073895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-427e36f1-6231-4d5b-a126-0a8148e32a3c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.361264 May 16 17:09:59.074470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 849/1490] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:09:59.080025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:59.080513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:59.085912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.086555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.087325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.087755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.101444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 HTTP/1.1 May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:09:59.103103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.104423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '24443e5c-42e0-4bfb-b5be-c856e1dfd645'} May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:09:59.105134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.106772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.108684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:09:59.108684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aba17fab-41ff-46dc-ba68-3529758d95fa tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 404 len: 111 microversion: 2.1 time: 0.029086 May 16 17:09:59.108684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 850/1491] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:09:59 2022] DELETE /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:09:59.109321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:59.110233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:59.116359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.116808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.117590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.118046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.146462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c392098f-c848-4d6a-ab5b-4b974c976c93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 May 16 17:09:59.147024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 851/1492] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:09:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:09:59.151367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:59.151967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:59.157430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.158482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.159253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.159712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.400480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:09:59.415097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-26149ea5-ffe5-4a50-8261-2ba9b87d4f7f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.267049 May 16 17:09:59.425893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 852/1493] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:59 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:09:59.425893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:09:59.425893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 24443e5c-42e0-4bfb-b5be-c856e1dfd645] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:09:59.429282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.429752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.430540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:09:59.430973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:09:59.444981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 HTTP/1.1 May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:09:59.446584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.448132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '24443e5c-42e0-4bfb-b5be-c856e1dfd645'} May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:09:59.448987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. May 16 17:09:59.450239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:09:59.451286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 24443e5c-42e0-4bfb-b5be-c856e1dfd645 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:09:59.451286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-92932706-5f98-45a9-abc0-fa8d0cc4a607 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645" status: 404 len: 111 microversion: 2.1 time: 0.030884 May 16 17:09:59.451286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 853/1494] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:09:59 2022] GET /compute/v2.1/servers/24443e5c-42e0-4bfb-b5be-c856e1dfd645 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:10:00.093493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:00.094225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:00.100799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:00.101245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:00.102042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:00.102463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:00.351556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:00.361394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f19cd521-0967-4b17-9119-0a6542bcfd0a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.272594 May 16 17:10:00.362126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 854/1495] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:00.371542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:00.371542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:00.377612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:00.378148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:00.379137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:00.379569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:00.417450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eaf18269-ae67-409f-af2d-9082f464fae4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054099 May 16 17:10:00.418095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 855/1496] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:00.439884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:00.440441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:00.446457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:00.446909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:00.447699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:00.448136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:00.656107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:00.664468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-37f95ab1-55e2-459a-80ad-195f322ca0e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.228554 May 16 17:10:00.665085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 856/1497] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:00 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:01.379128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:01.380210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:01.386111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:01.386642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:01.387527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:01.387967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:01.617660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:01.625926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce1d9a87-928c-4d35-bbba-39eaa44a74f8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.251346 May 16 17:10:01.636034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 857/1498] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:01.636034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:01.636034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:01.642348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:01.643401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:01.644113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:01.644592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:01.679460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-64634be7-0c2f-4756-bc03-cdcfc4761eed tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051229 May 16 17:10:01.680225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 858/1499] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:01.684904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:01.685513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:01.691655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:01.692107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:01.692898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:01.693333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:01.825536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:01.833899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-235fea13-382e-41a2-856c-dc34aeda233e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.152511 May 16 17:10:01.834846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 859/1500] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:01 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:02.645871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:02.646580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:02.665141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:02.666283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:02.668041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:02.669028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:03.176336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:03.183960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1a8f6035-db05-4412-9612-1cfe639b1bf2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.542757 May 16 17:10:03.184536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 860/1501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:03.191597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:03.191597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:03.198514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:03.198907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:03.199668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:03.200108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:03.230173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-84de6e79-e584-4cdf-baa9-bc6424871deb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 May 16 17:10:03.230742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 861/1502] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:03.235211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:03.235829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:03.241553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:03.242053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:03.242815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:03.243250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:03.500138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:03.508553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ec7d5f40-fcab-4321-b965-518992af48f8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.276852 May 16 17:10:03.509199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 862/1503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:03 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:04.202980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:04.203677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:04.210746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:04.211196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:04.211976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:04.212406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:04.424344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:04.436695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b4f1871d-9eae-4101-a1b2-4aea8f66d84d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.238139 May 16 17:10:04.447768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 863/1504] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:04.447768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:04.448475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:04.459783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:04.460213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:04.461628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:04.462456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:04.512845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-daeb9b54-2c5a-402a-b7a6-fcf2b97e7665 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073270 May 16 17:10:04.513808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 864/1505] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:04.525471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:04.526086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:04.532082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:04.532532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:04.533295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:04.533727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:04.838179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:04.852693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b190c4c9-1bc4-45a2-bbec-8829908b0527 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.330447 May 16 17:10:04.862933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 865/1506] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:04 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:05.456813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:05.457688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:05.466274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:05.466739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:05.467584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:05.468536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:05.705401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:05.717994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3834f2f7-fe24-4e30-8e36-09fffba4f816 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.266060 May 16 17:10:05.719404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 866/1507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:05.729034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:05.730431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:05.736931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:05.737383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:05.738275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:05.738699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:05.773588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-57202df7-e5de-4de8-891d-5142b09eefb7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051725 May 16 17:10:05.774323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 867/1508] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:05.875459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:05.877236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:05.887358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:05.888319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:05.889998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:05.890614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:06.183193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:06.202218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bec58559-1811-4561-9ea1-dd2c44d3da3e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.334459 May 16 17:10:06.210200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 868/1509] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:05 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:06.740450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:06.741126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:06.747347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:06.747789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:06.748551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:06.748984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:06.841967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:10:06.842464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc (ip 10.222.0.70) !!! May 16 17:10:06.888559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:06.895830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e01e259d-e27f-4cd5-8b35-213e632a7d53 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.159772 May 16 17:10:06.896410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 869/1510] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:06.900919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:06.901862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:06.907573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:06.908563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:06.909343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:06.909798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:06.938335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1c7a7c54-8f7e-4211-8acf-c95dd4fa2077 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040891 May 16 17:10:06.938927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 870/1511] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:07.222481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:07.223387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:07.229403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:07.230050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:07.230937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:07.231440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:07.386686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:07.395070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-46dbe5fb-da83-4005-87a6-94be062e8373 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.177015 May 16 17:10:07.395657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 871/1512] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:07 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:07.913416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:07.914148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:07.920790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:07.921241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:07.922059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:07.922495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:08.060152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:08.067985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cbea870f-f1c5-4217-9819-b49a425467dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.158412 May 16 17:10:08.068679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 872/1513] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:08.074453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:08.075836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:08.082048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:08.082500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:08.083268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:08.083701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:08.111561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2d965214-e4fb-4018-b809-16b25f9c5ab9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 May 16 17:10:08.112121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 873/1514] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:08.412322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:08.413116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:08.419246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:08.419699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:08.420499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:08.420933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:08.794142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:08.801802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8c29f487-3397-4c4d-9e98-ad49ac1d5b78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.393972 May 16 17:10:08.802382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 874/1515] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:08 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:09.085561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:09.086220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:09.092694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:09.093141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:09.093936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:09.094375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:09.231234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:09.239377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6ae4e299-980f-489a-b739-43302843d9b0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.157593 May 16 17:10:09.239965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 875/1516] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:09.244736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:09.245649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:09.252160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:09.252617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:09.253381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:09.253843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:09.281818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ad4b745c-7825-40a1-b85f-c829433eba47 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040809 May 16 17:10:09.282381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 876/1517] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:09.819246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:09.819773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:09.826231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:09.827775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:09.829292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:09.831588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:09.959393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:09.968578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3fd6f064-a17d-493f-a4b7-7d94e95e57b8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.153286 May 16 17:10:09.969145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 877/1518] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:09 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:10.257287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:10.258017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:10.264461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:10.264910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:10.265689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:10.266144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:10.405022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:10.417442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a4b64ab7-6944-440a-99cb-70fe15822458 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.163665 May 16 17:10:10.418406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 878/1519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:10.427099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:10.428613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:10.437602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:10.438312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:10.439445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:10.440146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:10.472578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f422cede-538b-4307-9b10-be3f2f276d76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050072 May 16 17:10:10.472578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 879/1520] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:10.985263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:10.986020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:10.992120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:10.992571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:10.993373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:10.993831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:11.142227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:11.156796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d75b3bf3-1b6b-4594-8bb6-50d027afe4e7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.174938 May 16 17:10:11.158380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 880/1521] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:10 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:11.436047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:11.436855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:11.443831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:11.444281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:11.445057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:11.445490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:11.578142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:11.585986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2b9b5c68-963f-44b5-a0bd-85641c7f14e2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.154010 May 16 17:10:11.586567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 881/1522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:11.591371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:11.592274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:11.598599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:11.599052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:11.599847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:11.600292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:11.627916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-71dce804-d01b-4c61-a52f-a74016437df2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040350 May 16 17:10:11.628469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 882/1523] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:12.181945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:12.182560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:12.188693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:12.189682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:12.190483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:12.190920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:12.321731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:12.329473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ff2b2c0b-3fdd-4a7a-8e28-3bc451fe986f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151450 May 16 17:10:12.330067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 883/1524] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:12 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:12.603418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:12.604451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:12.611467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:12.611927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:12.612748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:12.613192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:12.760384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:12.768376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7c5e1d2-abd1-43b3-9b09-a60ec3e63f1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.169116 May 16 17:10:12.768983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 884/1525] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:12.773888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:12.774848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:12.781217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:12.781670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:12.783129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:12.783559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:12.816901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c64a85fa-cc52-4e61-a6f8-601e9cfcbb7b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046837 May 16 17:10:12.817484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 885/1526] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:13.346317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:13.346937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:13.352863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:13.353312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:13.354113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:13.354552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:13.482077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:13.489883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dca6d516-72d6-4ab8-8d5b-5b3fbe09f247 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147346 May 16 17:10:13.490452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 886/1527] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:13 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:13.792072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:13.792719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:13.799432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:13.799869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:13.800641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:13.801080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:13.939900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:13.947174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bcc7f004-2de8-4915-a448-b6695eebbbcf tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.159093 May 16 17:10:13.947750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 887/1528] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:13.952313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:13.953209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:13.958783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:13.959228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:13.959982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:13.960412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:13.988912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-863347b2-e5d3-4262-b47b-ce5f01844889 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040170 May 16 17:10:13.989464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 888/1529] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:14.506871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:14.507473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:14.513275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:14.513731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:14.514496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:14.514921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:14.648457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:14.656303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-376a6eda-febe-424a-a337-5df2610e6be5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.153401 May 16 17:10:14.656877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 889/1530] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:14 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:14.964132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:14.964743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:14.971442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:14.971885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:14.972640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:14.973067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:15.113169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:15.121301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a9b75537-e2d5-4b32-a589-bd5c211c79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.160960 May 16 17:10:15.121903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 890/1531] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:15.126690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:15.127590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:15.133605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:15.134075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:15.134833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:15.135286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:15.165268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e1e81636-c704-482d-ac08-acb705a656fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 May 16 17:10:15.165855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 891/1532] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:15.674373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:15.674907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:15.681121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:15.681605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:15.682411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:15.682851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:15.810785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:15.819178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7edee87-710b-40e0-b635-5315fd8060fc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148748 May 16 17:10:15.819751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 892/1533] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:15 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:16.138593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:16.139287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:16.145764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:16.146220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:16.146977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:16.147407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:16.273678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:16.280929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-475c2680-1249-485f-8b33-11390bc2645f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.146184 May 16 17:10:16.281489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 893/1534] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:16.286703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:16.287594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:16.292926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:16.293369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:16.294168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:16.294600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:16.323253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cedf1a52-7b82-4136-ac86-6530b33ab1e9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040678 May 16 17:10:16.323824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 894/1535] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:16.836498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:16.837112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:16.843614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:16.844063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:16.844825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:16.845874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:16.986384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:16.994068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dd1bdbfe-c59a-44f2-bb30-71a80aff7b4c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.161547 May 16 17:10:16.994638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 895/1536] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:16 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:17.298592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:17.299245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:17.304936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:17.305384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:17.306183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:17.306619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:17.435019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:17.443018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe438d2f-74f6-47e6-89d4-1f02a382a866 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.148422 May 16 17:10:17.443583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 896/1537] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:17.448017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:17.448909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:17.454250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:17.454811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:17.455567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:17.455997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:17.484874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-90f9522d-ccfa-436c-86f2-a2c6e4ff8f69 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040307 May 16 17:10:17.485418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 897/1538] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:18.011007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:18.011631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:18.018061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:18.018517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:18.019285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:18.019725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:18.148375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:18.155928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-092f2b40-8e32-4208-832b-620b82dd40cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148742 May 16 17:10:18.156490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 898/1539] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:18 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:18.460559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:18.461210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:18.467275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:18.467718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:18.468465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:18.468889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:18.594318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:18.601495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-98c52f64-d624-4c6c-9690-9231a8c88aeb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.144816 May 16 17:10:18.602089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 899/1540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:18.606481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:18.607363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:18.612814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:18.613253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:18.614036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:18.614466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:18.642915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c99708fb-9db5-4236-9fc7-82b8c9434a56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039862 May 16 17:10:18.643455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 900/1541] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:19.172428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:19.173043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:19.179437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:19.179889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:19.180659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:19.181099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:19.313541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:19.321853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e6a9fcf5-12a7-4d10-8172-6b8239bc312e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.153293 May 16 17:10:19.322427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 901/1542] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:19 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:19.618572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:19.619271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:19.625891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:19.627060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:19.627954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:19.628386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:19.756817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:19.764190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f4d15ec6-52c6-4edc-9d25-34d31eb14a37 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149463 May 16 17:10:19.764761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 902/1543] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:19.769241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:19.770168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:19.775607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:19.776060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:19.776834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:19.777275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:19.806977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-65479dfb-4ba5-4957-aa82-ddd9861e07e0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 May 16 17:10:19.807547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 903/1544] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:20.339384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:20.339988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:20.347010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:20.347450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:20.348352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:20.348802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:20.479329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:20.487039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0023344a-8826-43d0-939f-e4fd15dcc364 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151452 May 16 17:10:20.487609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 904/1545] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:20 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:20.781522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:20.782206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:20.790514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:20.790514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:20.790514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:20.790514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:20.930161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:20.937599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f224d763-62d5-4435-9273-932a127b3719 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.160300 May 16 17:10:20.938191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 905/1546] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:20.943330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:20.944220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:20.949647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:20.950118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:20.950879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:20.951307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:20.980788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17dfdefd-d638-4c28-9d7e-5ff39ca163b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 May 16 17:10:20.981349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 906/1547] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:21.504593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:21.505190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:21.511505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:21.511947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:21.512705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:21.513132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:21.636622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:21.644277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5c8c62ea-520f-425f-b76d-be53fe80e29b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144290 May 16 17:10:21.644843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 907/1548] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:21 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:21.959046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:21.959742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:21.967836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:21.968497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:21.969771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:21.970992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:22.123302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:22.132824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3df4ec59-5915-4d91-b19e-049c10ca82de tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.180658 May 16 17:10:22.133843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 908/1549] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:22.140939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:22.142990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:22.151561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:22.152266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:22.153609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:22.154309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:22.206462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a9ac9898-468a-4177-946b-8107367c21d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071280 May 16 17:10:22.207119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 909/1550] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:22.445725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 16 17:10:22.446056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:10:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:10:22.664546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:22.665292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:22.675916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:22.676429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:22.677211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:22.677643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:22.833889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:22.842901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e0aa7d32-f0b9-4ca9-b29f-7800a973548c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.185678 May 16 17:10:22.843455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 910/1551] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:22 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:23.154403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:23.155083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:23.162016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:23.162469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:23.163256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:23.163689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:23.311134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:23.318927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4b885a2e-82fc-4a04-bebf-3cb7c169bb7f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.169726 May 16 17:10:23.319492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 911/1552] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:23.323950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:23.324850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:23.331114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:23.331557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:23.332324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:23.332756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:23.361881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4f2c24e1-6fcf-4f96-96dc-c980c78d20bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 May 16 17:10:23.362441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 912/1553] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:23.860331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:23.860953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:23.867264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:23.867708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:23.868454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:23.868881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:23.997190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:24.005985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-efc1e367-bd7a-4523-b0bf-19991e8bcb01 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149415 May 16 17:10:24.006550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 913/1554] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:23 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:24.336752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:24.337412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:24.343526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:24.343968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:24.344739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:24.345717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:24.480944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:24.488744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ac327752-26da-4d5f-9175-0220625c9b8b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.155883 May 16 17:10:24.489318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 914/1555] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:24.493847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:24.494757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:24.500574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:24.501055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:24.502405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:24.502843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:24.531850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7148eaeb-141b-4d34-8856-ccd83d7c53e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 May 16 17:10:24.532430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 915/1556] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:25.023400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:25.024045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:25.030330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:25.030783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:25.031548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:25.031985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:25.165929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:25.173647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5856ae12-4fd7-43a1-a868-7b3341e3b4e2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.154186 May 16 17:10:25.174264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 916/1557] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:25 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:25.505915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:25.506599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:25.512522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:25.512967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:25.513719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:25.514174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:25.641569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:25.648896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-927176fa-b14c-4809-b0af-0346a8a86ff8 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.146823 May 16 17:10:25.649465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 917/1558] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:25.653971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:25.654879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:25.660923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:25.661374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:25.662180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:25.662617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:25.691736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-38867573-6546-4213-a397-ece3c1e91327 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 May 16 17:10:25.692220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 918/1559] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:26.192243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:26.192880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:26.199185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:26.199636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:26.200399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:26.200836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:26.334541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:26.343277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-62e24b60-799e-46d8-a6bd-0040deee48aa tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.156076 May 16 17:10:26.343860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 919/1560] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:26 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:26.666770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:26.667475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:26.674003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:26.674445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:26.675199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:26.675628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:26.815931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:26.825010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d63d5a90-dbbd-4988-9213-3b6237c5b2da tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.162064 May 16 17:10:26.825577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 920/1561] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:26.830298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:26.831219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:26.837287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:26.837750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:26.838523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:26.838955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:26.868721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e15f3b6a-a946-41ee-a1ee-a7e625547dae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 May 16 17:10:26.869279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 921/1562] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:27.361060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:27.361667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:27.367974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:27.368421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:27.369192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:27.369629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:27.507824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:27.519143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-24b60e46-9138-49d3-86d2-3f2b951b62c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.162364 May 16 17:10:27.519737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 922/1563] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:27 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:27.842533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:27.843235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:27.849565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:27.850034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:27.850798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:27.851228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:27.981014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:27.988326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d868f94-96af-4a0f-9f37-305b170aa4b9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149885 May 16 17:10:27.988895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 923/1564] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:27.993310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:27.994276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:27.999641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:28.000089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:28.000846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:28.001278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:28.029063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-69b2a764-2e6c-45e3-875f-c8c9f7d85546 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039222 May 16 17:10:28.029617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 924/1565] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:28.535942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:28.536554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:28.542903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:28.543354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:28.544132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:28.544566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:28.672118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:28.680843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f661a1e8-2156-46db-b64c-ba241f2e9115 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148762 May 16 17:10:28.681414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 925/1566] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:28 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:29.005959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:29.006616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:29.012442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:29.012879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:29.013636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:29.014090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:29.144145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:29.151487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83d4d86f-a61f-4cdd-b752-c0f059c63a93 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.150023 May 16 17:10:29.152061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 926/1567] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:29.156532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:29.157431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:29.163696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:29.164136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:29.164889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:29.165318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:29.194279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b53858f0-91e0-4c0d-af4c-c3224a0fc43a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 May 16 17:10:29.194831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 927/1568] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:29.698701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:29.699268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:29.706386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:29.706839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:29.707625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:29.708059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:29.838111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:29.846124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3082b8a6-4501-4ea5-b6bc-3cf6cb275340 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151407 May 16 17:10:29.846698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 928/1569] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:29 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:30.169081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:30.169798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:30.176301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:30.176742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:30.177496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:30.177948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:30.306823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:30.314139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c1169420-5d36-4b2f-b700-41167df55040 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149074 May 16 17:10:30.315333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 929/1570] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:30.319797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:30.320698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:30.326174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:30.326624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:30.327389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:30.327834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:30.356360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-73e16867-6602-4a7e-adc2-6b26322ad0d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039989 May 16 17:10:30.356930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 930/1571] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:30.863524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:30.864131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:30.871037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:30.871637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:30.872556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:30.873023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:31.000615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:31.008685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41863b32-0495-4b00-b6bc-7b86f2b8109c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149592 May 16 17:10:31.009258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 931/1572] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:30 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:31.332203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:31.332854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:31.338621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:31.339068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:31.339824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:31.340513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:31.465991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:31.473610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7e84f0ed-d9fe-422b-81f1-89a8c6e9b328 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.145746 May 16 17:10:31.474218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 932/1573] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:31.478856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:31.479764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:31.485574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:31.486056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:31.486831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:31.487268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:31.515189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-50d6653e-348f-4ad3-9766-94d4afcb9acc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040008 May 16 17:10:31.515743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 933/1574] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:32.026176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:32.026701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:32.033411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:32.033879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:32.034632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:32.035060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:32.164281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:32.171973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7fb3187-d401-422e-905b-0a087e816a78 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149722 May 16 17:10:32.172544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 934/1575] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:32 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:32.492540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:32.493192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:32.498953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:32.499397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:32.500147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:32.500575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:32.628111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:32.635274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5b1b02b2-ce05-4787-8138-ce3ef696ec19 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.146569 May 16 17:10:32.635838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 935/1576] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:10:32.640279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:32.641162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:32.647327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:32.647775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:32.648544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:32.648977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:32.677250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-98490803-9198-42c4-b530-23e00cf14f4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040378 May 16 17:10:32.677731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 936/1577] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:33.190161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:33.190773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:33.197152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:33.197592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:33.198372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:33.198801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:33.325116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:33.332660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-68c2e218-36e6-4358-a17e-8ef33911d863 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147081 May 16 17:10:33.333225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 937/1578] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:33 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:33.652360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:33.653002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:33.659329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:33.659769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:33.660515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:33.660942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:33.785441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:33.792643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b349ea6b-26ea-4747-8e2c-a1a9e422ba38 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.144131 May 16 17:10:33.793201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 938/1579] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:33.797580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:33.798491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:33.804062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:33.804670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:33.805442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:33.805912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:33.834664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e9a66bf6-749e-4387-b67a-3eaa9538f5c6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040490 May 16 17:10:33.835212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 939/1580] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:34.349605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:34.350244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:34.356522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:34.356970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:34.357730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:34.358187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:34.482073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:34.489654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0fa31778-2831-458f-a829-581649f73aa4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143817 May 16 17:10:34.490250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 940/1581] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:34 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:34.809820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:34.810470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:34.816779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:34.817224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:34.818000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:34.818425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:34.945728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:34.952981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-39cf2177-1ed5-4b9a-92e2-afdf1f555db7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147147 May 16 17:10:34.953546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 941/1582] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:34.958103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:34.958987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:34.964352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:34.964809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:34.965803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:34.966251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:34.993987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-86a5e0be-b61c-41ca-b3db-7b780b97ccc2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039423 May 16 17:10:34.994530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 942/1583] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:34 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:35.506674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:35.507289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:35.513565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:35.514049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:35.514814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:35.515246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:35.646283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:35.653941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cfff6c70-e130-410b-b9c0-19277b11eecd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151060 May 16 17:10:35.654501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 943/1584] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:35 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:35.969633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:35.970291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:35.976083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:35.976531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:35.977291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:35.977724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:36.107075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:36.114389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f85fd21c-29c3-4476-82fd-fedcab431ea6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149009 May 16 17:10:36.114953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 944/1585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:36.119525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:36.120417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:36.125766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:36.126218 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:36.127481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:36.127931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:36.156214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-489eb333-0989-4e50-9315-f63a1c823e88 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040283 May 16 17:10:36.156756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 945/1586] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:36.671240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:36.671776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:36.678672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:36.679121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:36.679913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:36.680350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:36.803465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:36.811530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-56ff1d1d-82ee-47b9-9bc2-80f1a65e5d9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144223 May 16 17:10:36.812094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 946/1587] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:36 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:37.131157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:37.131774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:37.137708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.138193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.138957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.139393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.264296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:37.272130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4fe2838b-4118-4a90-a892-2d9c984bbb51 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.144843 May 16 17:10:37.272699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 947/1588] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:37.277146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:37.278062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:37.284211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.284660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.285478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.285943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.313255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4d1ab824-04dc-4dbb-8591-779109e8c0ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039602 May 16 17:10:37.313810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 948/1589] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:10:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:10:37.828312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:37.828923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:37.835693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.836142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.836908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.837344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.963969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:10:37.972501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b8b43ea-c7b5-4f10-8641-03898ccdbc3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148026 May 16 17:10:37.973070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 949/1590] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:10:37 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:10:37.977562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:10:37.978079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:10:37.983450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.983897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:10:37.984652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:10:37.985080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.684519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Request method failure captured: May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc HTTP/1.1 May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoLEX0V3p-2_bGNdQv5uW6avMJDBGpBvNKnAWV3tcqSSgh_cr9EWrcg5uUMy1yyKL6EMa1TS4dEcPXMLsl0ZRLHN6P5H7bZ4qVzLIB9_rVFykzoWXE-IjNT-BcgPctnTOPRbyapbT_W6W4ZGQL5Fmt1QfbzUPwaTBqNe-bR7q8b3RS8 May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: e07bcaeeb617491689c13594914b370e May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:11:38.687743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e07bcaeeb617491689c13594914b370e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e07bcaeeb617491689c13594914b370e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: e07bcaeeb617491689c13594914b370e May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 3ab541e9017c4ece9432f1fedde0f64e May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:11:38.689156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'server_id': '38da705b-728f-449a-99ef-1428962695d3', 'id': 'caece44f-fa74-47ca-b9b2-3328236ee4dc'} May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:11:38.689956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:11:38.691067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.692303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:11:38.693384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) May 16 17:11:38.694775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:11:38.696072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-753a2a15-3d61-4113-95cc-67f4c12ca79a) {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:11:38.696072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a12a0b57-1d62-43d9-9861-f1d2b5af5bfc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc" status: 400 len: 269 microversion: 2.1 time: 120.010986 May 16 17:11:38.696072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 642/1591] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:09:38 2022] DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc => generated 269 bytes in 120012 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:11:38.696353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:38.697155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:38.703671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.704146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.704917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.705383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.805355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'services' on Instance uuid 38da705b-728f-449a-99ef-1428962695d3 {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:11:38.837111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:38.845012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-48cf3947-0c23-48b0-a7b5-e2e53f541df5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.153575 May 16 17:11:38.845671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 643/1592] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:38.850445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:38.851806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:38.857610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.858120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.859089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.859314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.888853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8ee57b41-4aff-440a-b345-dfc66d0a22e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 May 16 17:11:38.889413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 644/1593] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:38.893871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:38.894476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:38.899827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.900280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.901050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.901492 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.908852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Request method failure captured: May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc HTTP/1.1 May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoLEX0V3p-2_bGNdQv5uW6avMJDBGpBvNKnAWV3tcqSSgh_cr9EWrcg5uUMy1yyKL6EMa1TS4dEcPXMLsl0ZRLHN6P5H7bZ4qVzLIB9_rVFykzoWXE-IjNT-BcgPctnTOPRbyapbT_W6W4ZGQL5Fmt1QfbzUPwaTBqNe-bR7q8b3RS8 May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: e07bcaeeb617491689c13594914b370e May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:11:38.911054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e07bcaeeb617491689c13594914b370e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e07bcaeeb617491689c13594914b370e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: e07bcaeeb617491689c13594914b370e May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 3ab541e9017c4ece9432f1fedde0f64e May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:11:38.912621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'server_id': '38da705b-728f-449a-99ef-1428962695d3', 'id': 'caece44f-fa74-47ca-b9b2-3328236ee4dc'} May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:11:38.913853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:11:38.915954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.918412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:11:38.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) May 16 17:11:38.924209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:38.926501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3a3f208-85e1-4dab-a6d6-daed434923a8) {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:11:38.926501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7bb4b942-3590-456c-8290-617f5f53fc87 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc" status: 400 len: 269 microversion: 2.1 time: 60.938749 May 16 17:11:38.926501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 950/1594] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:10:37 2022] DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc => generated 269 bytes in 60940 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:11:38.926501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:38.927106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:38.928172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.928621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:38.929379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:38.929836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.008648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lazy-loading 'services' on Instance uuid 38da705b-728f-449a-99ef-1428962695d3 {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:11:39.037711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:39.045485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-925e31ad-dee3-463d-be25-fe4b1f2c6a7b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.155107 May 16 17:11:39.046084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 645/1595] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:38 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:39.051017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:39.051625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:39.057135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:39.057591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.058388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:39.058825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.064124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Request method failure captured: May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc HTTP/1.1 May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoLEX0V3p-2_bGNdQv5uW6avMJDBGpBvNKnAWV3tcqSSgh_cr9EWrcg5uUMy1yyKL6EMa1TS4dEcPXMLsl0ZRLHN6P5H7bZ4qVzLIB9_rVFykzoWXE-IjNT-BcgPctnTOPRbyapbT_W6W4ZGQL5Fmt1QfbzUPwaTBqNe-bR7q8b3RS8 May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: e07bcaeeb617491689c13594914b370e May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:11:39.066346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e07bcaeeb617491689c13594914b370e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e07bcaeeb617491689c13594914b370e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e07bcaeeb617491689c13594914b370e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: e07bcaeeb617491689c13594914b370e May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1770920123 May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 3ab541e9017c4ece9432f1fedde0f64e May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesSnapshotTestJSON-1770920123-project May 16 17:11:39.067855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'server_id': '38da705b-728f-449a-99ef-1428962695d3', 'id': 'caece44f-fa74-47ca-b9b2-3328236ee4dc'} May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:11:39.068561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:11:39.069581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:39.070746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:11:39.071745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) May 16 17:11:39.072794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:11:39.073974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-457151d6-cab9-4aee-a5ff-362351feaf53) {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:11:39.073974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3c207399-db94-43cd-b811-bca6a467762c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc" status: 400 len: 269 microversion: 2.1 time: 0.153261 May 16 17:11:39.073974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 951/1596] 10.222.0.70 () {58 vars in 1415 bytes} [Mon May 16 17:11:38 2022] DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3/os-volume_attachments/caece44f-fa74-47ca-b9b2-3328236ee4dc => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:11:39.076068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:39.077465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:39.083311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:39.083766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.084543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:39.084985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.115157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a8a75988-0b51-4233-8db2-4a9f98600be2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 May 16 17:11:39.115732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 952/1597] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:39.120705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:39.121642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:39.128650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:39.129107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.129919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:39.130363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:39.196492 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:39.203973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f271b79b-7a4e-428c-8c75-605e9b3d62b2 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.156920 May 16 17:11:39.204579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 646/1598] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:39.272654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:39.280684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0c10afec-35b0-4473-b467-4b7b01f955d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.163559 May 16 17:11:39.281250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 953/1599] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:39 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:40.127318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:40.128280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:40.134842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:40.135299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:40.136074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:40.136516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:40.166379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d6cac253-5442-4125-bb39-b7588ad5521b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 May 16 17:11:40.166935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 647/1600] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:40.220522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:40.221220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:40.227473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:40.227945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:40.228731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:40.229170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:40.300379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:40.300987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:40.309181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:40.309181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:40.309181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:40.310845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:40.368650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:40.376731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d4c93b19-c90e-40c9-927d-622c87af4978 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.159374 May 16 17:11:40.377316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 954/1601] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:40.437359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:40.445752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-02f16463-f087-4197-a351-74692ec4cacd tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149248 May 16 17:11:40.446323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 648/1602] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:40 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:11:41.178411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:41.179368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:41.185214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:41.185655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:41.186432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:41.186862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:41.215021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe969a07-3ec1-4a8c-a155-00eba754597b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040264 May 16 17:11:41.215558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 955/1603] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:41 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:41.394062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:41.394692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:41.401033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:41.401488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:41.402301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:41.402743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:41.463367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:41.463990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:41.470946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:41.471396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:41.472168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:41.472604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:41.535632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:41.543141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-47fcfe74-1be2-4489-b915-309ef9b8b239 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.152910 May 16 17:11:41.543833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 649/1604] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:41.600437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:41.608099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8ae86699-a045-4980-b135-b74b6fdf77ba tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148714 May 16 17:11:41.608675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 956/1605] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:41 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:11:42.226651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:42.227585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:42.233499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:42.233993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:42.234768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:42.235241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:42.269226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e6f04f7f-1dff-40b8-af54-9c84f0f205ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 May 16 17:11:42.269811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 650/1606] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:42.560918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:42.561448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:42.568536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:42.568984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:42.569766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:42.570203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:42.626716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:42.627511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:42.635378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:42.635835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:42.636608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:42.637085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:42.702395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:42.709650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d1d91e63-9676-4e58-81e2-de0748a8057c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.152683 May 16 17:11:42.710961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 957/1607] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:42.762222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:42.769957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e322b251-0b2e-4bdc-be79-2feae7d14747 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147831 May 16 17:11:42.770525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 651/1608] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:42 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:43.280752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:43.281600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:43.287603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:43.288051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:43.288829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:43.289269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:43.317427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9be6974d-c816-422b-ad98-fe861b7ddfa8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040743 May 16 17:11:43.318012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 958/1609] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:43.726930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:43.727537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:43.733857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:43.734302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:43.735059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:43.736126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:43.788341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:43.789557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:43.796114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:43.796645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:43.797512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:43.798612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:43.869679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:43.877007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3b1c8605-ee5b-42c2-8606-57164427bc25 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.153938 May 16 17:11:43.882044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 652/1610] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:44.116421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:44.123974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-75450608-21b7-4c66-9d47-56ce611c9582 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.340382 May 16 17:11:44.124536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 959/1611] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:43 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:11:44.329461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:44.330349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:44.336194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:44.336646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:44.337446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:44.337914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:44.366643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f074efa0-4524-4122-a71b-09b29b7f50d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041712 May 16 17:11:44.367199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 653/1612] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:44.893947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:44.894552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:44.900369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:44.900814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:44.901568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:44.902025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:45.026177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:45.033406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f0e2620-8fec-4c34-b625-7f31ef5b77e9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.143546 May 16 17:11:45.033996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 960/1613] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:45.141928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:45.142552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:45.148653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:45.149047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:45.149883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:45.150347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:45.273009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:45.280657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d4f7f895-5a04-4e2a-8db1-410f97a9e63b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143388 May 16 17:11:45.281232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 654/1614] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:45 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:45.377936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:45.378880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:45.384866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:45.385311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:45.386100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:45.386536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:45.414966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a84ae451-f8eb-4531-9250-35f2d0aa7552 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040851 May 16 17:11:45.415536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 961/1615] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:46.050354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:46.050973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:46.056870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:46.057324 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:46.058126 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:46.058564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:46.186246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:46.194115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c3f3e525-bef2-4ec4-bbf3-4a7e54856b21 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147647 May 16 17:11:46.194690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 655/1616] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:46.298039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:46.298646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:46.304914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:46.305307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:46.306088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:46.306523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:46.427086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:46.428017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:46.433899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:46.434274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:46.435064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:46.435513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:46.436351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:46.444671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f483a6bf-e04a-407a-9b4a-b0198040db51 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150430 May 16 17:11:46.445249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 962/1617] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:46 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:46.464911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-99798726-7e0d-41c4-8b0a-fe614a8287ce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 May 16 17:11:46.465546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 656/1618] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:11:47.211064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:47.211676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:47.217943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:47.218394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:47.219154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:47.220232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:47.345759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:47.352989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0d6f2779-d9cd-45c8-a737-6fc2f1981c7b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.145945 May 16 17:11:47.353563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 963/1619] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:47.461307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:47.461958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:47.468903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:47.469362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:47.470236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:47.470669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:47.476234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:47.477221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:47.482977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:47.483421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:47.484170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:47.484605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:47.514461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bc74d5cb-cca1-41e1-b535-a2ac5c163e40 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042000 May 16 17:11:47.515028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 964/1620] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:11:47.599976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:47.607714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb5f5324-8da1-4051-9567-435819656bb2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150284 May 16 17:11:47.608280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 657/1621] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:47 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:48.369849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:48.370455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:48.377192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:48.377634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:48.378445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:48.378876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:48.508105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:48.515358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8a01c14d-d02a-4eb5-a7d4-908a58f2439b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.149351 May 16 17:11:48.515938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 965/1622] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:48.526465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:48.527425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:48.533676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:48.534168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:48.534943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:48.535388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:48.563001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d496691f-ab44-4a71-a0ef-706d44959c57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040460 May 16 17:11:48.564061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 658/1623] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:48.624469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:48.624999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:48.631507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:48.631963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:48.632731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:48.633167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:48.756909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:48.764667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1863bb16-4656-4af5-9a4f-a0a890142aea tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144041 May 16 17:11:48.765233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 966/1624] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:48 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:49.532978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:49.533616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:49.540295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:49.540749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:49.541521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:49.541990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:49.575477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:49.576404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:49.583415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:49.583870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:49.584647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:49.585084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:49.615554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-477f53f0-be30-4069-b6b0-a151bc1fa23f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 May 16 17:11:49.616122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 967/1625] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:11:49.673433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:49.681365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5e4fbc81-c4ea-4d44-ac37-9d5f96eb3e9f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.152376 May 16 17:11:49.682023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 659/1626] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:49.781599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:49.782234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:49.788100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:49.788550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:49.789312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:49.789793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:49.915406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:49.922989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-38885f24-a86b-4357-85e3-88c82da64378 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145257 May 16 17:11:49.923553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 968/1627] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:49 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:50.626955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:50.627853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:50.634144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:50.634592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:50.635351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:50.635783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:50.663774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d9e407a2-70a5-424b-9b60-a34bc79e2006 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040731 May 16 17:11:50.664248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 660/1628] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:50.698831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:50.699445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:50.705700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:50.706173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:50.706929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:50.707359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:50.834690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:50.842148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a3fc8230-e6fb-4b22-96e6-b2c235fb91dd tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147144 May 16 17:11:50.842724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 969/1629] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:50.939179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:50.939713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:50.945462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:50.945942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:50.946700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:50.947135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:51.073163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:51.081462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ee35b786-2f17-4f7c-924b-2e8b2269148e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146203 May 16 17:11:51.082063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 661/1630] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:50 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:51.677158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:51.678043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:51.685889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:51.686748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:51.687503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:51.687932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:51.717383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e646fc8f-b1f8-401e-95c6-879e95730cad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 May 16 17:11:51.718100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 970/1631] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:51.860671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:51.861283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:51.867593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:51.868038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:51.868796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:51.869227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:52.000708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:52.008815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-275c60d8-6990-4273-ad52-0f4492d81518 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.152808 May 16 17:11:52.009394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 662/1632] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:51 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:52.098454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:52.099057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:52.104839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:52.105286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:52.106061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:52.106489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:52.229629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:52.238191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-376d2922-8ab9-43c8-abbd-fe0700bbd72f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144017 May 16 17:11:52.238770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 971/1633] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:52 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:52.728990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:52.729972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:52.736007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:52.736510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:52.737279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:52.737717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:52.766026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4b9de1aa-5a6d-4a33-acb1-c400aa08a2c7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 May 16 17:11:52.767267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 663/1634] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:53.025633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:53.026282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:53.032505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:53.032948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:53.033707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:53.034166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:53.163054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:53.170356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c7f51039-58e8-4266-b0fc-1adeda96521b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.148550 May 16 17:11:53.170931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 972/1635] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:53.254713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:53.255328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:53.261624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:53.262055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:53.262821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:53.263293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:53.389718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:53.397602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-39fbe7a2-ddbf-45ce-bf4f-9bf995a2bcae tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147465 May 16 17:11:53.398205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 664/1636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:53 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:53.777721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:53.778672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:53.785042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:53.785491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:53.786294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:53.786726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:53.817547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-57d31069-98e4-4e17-8fab-f4309fb7325a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 May 16 17:11:53.819099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 973/1637] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:54.187892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:54.189131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:54.194998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:54.195455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:54.196296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:54.196670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:54.320889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:54.328260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a324dfc6-aef2-4288-b76a-26e00cf218bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.144316 May 16 17:11:54.329466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 665/1638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:54.414991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:54.415416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:54.421300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:54.421756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:54.422526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:54.422949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:54.546714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:54.554361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-22bee388-3169-4f3b-8473-c59b26eeb3b6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143649 May 16 17:11:54.554930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 974/1639] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:54 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:54.830197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:54.831128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:54.837150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:54.837612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:54.838412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:54.838858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:54.867539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8efd4a92-10d4-4c0d-88e5-0094a69c6005 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 May 16 17:11:54.868087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 666/1640] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:55.346835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:55.347483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:55.353247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:55.353696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:55.354482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:55.354908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:55.483528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:55.490849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe4fa23c-0ac1-48f6-94a8-2a466a722fd0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.148505 May 16 17:11:55.491423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 975/1641] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:11:55.570836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:55.571454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:55.577753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:55.578223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:55.579599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:55.580041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:55.721176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:55.729087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6ba3dce9-8fe8-4393-930e-ddadf7aef8d5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.162072 May 16 17:11:55.729663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 667/1642] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:55 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:55.879674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:55.880584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:55.886499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:55.886942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:55.887695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:55.888127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:55.916205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ff04b7c7-ada3-4f6a-990a-966430652232 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041010 May 16 17:11:55.916681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 976/1643] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:56.507956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:56.508567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:56.514424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:56.514873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:56.516198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:56.516635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:56.644358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:56.651610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b90562ff-dd21-47cd-a2e1-e0c83b5955c0 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.147593 May 16 17:11:56.652173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 668/1644] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:56.745993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:56.746610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:56.754066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:56.754519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:56.755303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:56.755766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:56.881363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:56.889008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-26428686-f369-42c5-bca3-702458cf0ccb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146895 May 16 17:11:56.889580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 977/1645] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:56 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:56.927565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:56.928497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:56.934341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:56.934800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:56.935574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:56.936016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:56.964667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-31621a43-11ac-46ae-8486-1d99066cac31 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040798 May 16 17:11:56.965157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 669/1646] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:57.668376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:57.668902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:57.675200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:57.675640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:57.676384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:57.676828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:57.803117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:57.810683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-04b68538-92d2-4518-ab5b-2b45ac75c029 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1446 microversion: 2.1 time: 0.146195 May 16 17:11:57.811274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 978/1647] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:57.907390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:57.908118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:57.914216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:57.914680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:57.915534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:57.916045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:57.976478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:57.977328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:57.983552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:57.984008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:57.984831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:57.985276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:58.014687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-50042f6f-e7c0-41ea-a8b9-06043687ee96 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 May 16 17:11:58.015266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 979/1648] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:58.147291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:58.160918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c503e451-41c0-4492-a63d-a3c86f80f8c5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.257979 May 16 17:11:58.161657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 670/1649] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:57 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:58.461963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-7fdde574-29d2-44f8-afa3-7c106b00f175 req-5126437c-8efb-4448-83d4-fc126c80b93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c2033c-4fee-4884-a6f7-de043836ebad", "name": "network-vif-deleted", "tag": "fd7ba01c-f563-4085-b558-b1c5bd0db5a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:11:58.470538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-7fdde574-29d2-44f8-afa3-7c106b00f175 req-5126437c-8efb-4448-83d4-fc126c80b93e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:58.470835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-7fdde574-29d2-44f8-afa3-7c106b00f175 req-5126437c-8efb-4448-83d4-fc126c80b93e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:58.482711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-7fdde574-29d2-44f8-afa3-7c106b00f175 req-5126437c-8efb-4448-83d4-fc126c80b93e service nova] Creating event network-vif-deleted:fd7ba01c-f563-4085-b558-b1c5bd0db5a6 for instance d5c2033c-4fee-4884-a6f7-de043836ebad on hv-cinder-83998 May 16 17:11:58.488661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-7fdde574-29d2-44f8-afa3-7c106b00f175 req-5126437c-8efb-4448-83d4-fc126c80b93e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030469 May 16 17:11:58.489267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 980/1650] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:11:58.828601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:58.829169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:58.837627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:58.838113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:58.838894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:58.839600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:58.902946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:58.911087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c31a93cc-0e75-4501-a6a5-0f9be2998885 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.086474 May 16 17:11:58.911643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 671/1651] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:58 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:59.027742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:59.028736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:59.035398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:59.035841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:59.036597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:59.037028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:59.064957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dcb427e1-3e74-425d-9eb3-46b0d5a9cb04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 May 16 17:11:59.065502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 981/1652] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:11:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:11:59.178338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:59.178945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:59.185182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:59.185635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:59.186435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:59.186871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:59.313351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:11:59.321120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b518c55d-582d-465e-9f18-28737cb22f53 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146786 May 16 17:11:59.321694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 672/1653] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:59 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:11:59.928808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:11:59.929419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:11:59.935204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:59.935642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:59.936389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:11:59.936818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:11:59.999786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:00.007735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fb73561c-5e63-4c9b-8539-4c7c75d09b56 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082757 May 16 17:12:00.008307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 982/1654] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:11:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:00.076423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:00.077356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:00.083420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:00.083872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:00.084634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:00.085074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:00.113561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-10694db2-bf5a-469f-907b-58f9d631c1e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041087 May 16 17:12:00.114136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 673/1655] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:00.338642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:00.339508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:00.346405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:00.346861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:00.347635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:00.348073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:00.474533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:00.482089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83395567-8215-4d05-9530-efc4aa1b5d5b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147314 May 16 17:12:00.482653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 983/1656] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:00 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:01.024306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:01.024965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:01.031400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:01.031870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:01.032624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:01.033067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:01.092301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:01.099552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-54e23e13-5f02-4713-be35-9a07a76669fb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079086 May 16 17:12:01.100121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 674/1657] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:01.124409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:01.125876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:01.131597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:01.132053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:01.132818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:01.133274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:01.161538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-315d16c5-5c54-4509-bf2b-8eb768cf3c2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 May 16 17:12:01.162062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 984/1658] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:01.499775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:01.500989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:01.506932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:01.507381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:01.508150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:01.508573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:01.641178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:01.649230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-da1d94ad-ef8e-4a3e-b4be-8f6221f99d42 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.153331 May 16 17:12:01.649830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 675/1659] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:01 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:02.116670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:02.117286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:02.123624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:02.124078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:02.124846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:02.125394 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:02.173011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:02.173988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:02.180458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:02.180907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:02.181669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:02.182128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:02.185102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:02.193065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d6e219d9-b1a8-47ae-8b81-1287dc6b36eb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080294 May 16 17:12:02.193641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 985/1660] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:02.211102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e30cc71a-cf1f-4ba8-9998-821afe0def89 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 May 16 17:12:02.211653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 676/1661] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:02.666446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:02.667011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:02.673686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:02.674161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:02.674931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:02.675367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:02.800050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:02.808141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-94d12f56-ab06-4260-9772-666fe179a799 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145669 May 16 17:12:02.808701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 986/1662] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:02 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:03.210680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:03.211306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:03.217977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:03.218433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:03.219204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:03.219652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:03.222694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:03.223612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:03.229861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:03.230314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:03.231105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:03.231539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:03.260452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-74aca13e-d291-4734-90be-5dc65dbce7d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 May 16 17:12:03.260982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 987/1663] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:03.283357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:03.290716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e5212f18-ecca-4d45-aa4b-c773ba2a602e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084015 May 16 17:12:03.291284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 677/1664] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:03.824288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:03.824937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:03.831005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:03.831450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:03.832210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:03.832643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:03.959930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:03.967955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1cd222c9-1f88-4a97-9161-f8cc6c279577 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147430 May 16 17:12:03.968541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 988/1665] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:03 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:04.272550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:04.273483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:04.279877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:04.280336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:04.281116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:04.281570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:04.315771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:04.316378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:04.322655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:04.323098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:04.323863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:04.324293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:04.324976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1f109eec-c4a4-4e00-aa64-f60a0826cc4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056354 May 16 17:12:04.325807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 678/1666] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:04.384090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:04.391284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e1ef8857-2c3c-4d90-a79d-5dd20530520b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079867 May 16 17:12:04.391841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 989/1667] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:04.984418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:04.985880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:04.991947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:04.992390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:04.993162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:04.993594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:05.336377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:05.337325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:05.343755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:05.344861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:05.345624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:05.346083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:05.361180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:05.368863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f8bca0c-948b-4286-b051-7f4184d88cc1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.388322 May 16 17:12:05.369428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 679/1668] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:04 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:05.374112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d188008-d46f-4377-82f3-a94f27c6046f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 May 16 17:12:05.374668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 990/1669] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:05.408378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:05.409004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:05.415461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:05.415603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:05.416381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:05.416822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:05.478927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:05.486276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9894c566-75c3-4d22-b8d1-3ac2051f4ca9 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082393 May 16 17:12:05.486842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 680/1670] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:06.385826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:06.386387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:06.386760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:06.386867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:06.393636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:06.393819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:06.394109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:06.394232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:06.394875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:06.394986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:06.395308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:06.395423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:06.425071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-11bd9ebb-038f-4990-818a-5b9a154f56d5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 May 16 17:12:06.425649 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 991/1671] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:06.503579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:06.504197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:06.509979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:06.510429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:06.511196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:06.511631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:06.524738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:06.532366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1bff8acb-27cb-4a75-9136-c6c954dad02f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150293 May 16 17:12:06.533047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 681/1672] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:06 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:06.574087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:06.582076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6095fe21-9442-443a-ab24-24ba3297d308 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082803 May 16 17:12:06.582648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 992/1673] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:07.436587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:07.437511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:07.443813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:07.444260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:07.445019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:07.445456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:07.475108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7229892c-47a5-4d4e-a33b-b105bdd49540 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 May 16 17:12:07.475659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 682/1674] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:07.548207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:07.548826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:07.555155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:07.555607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:07.556407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:07.556850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:07.599635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:07.600375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:07.606148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:07.606594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:07.607356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:07.607786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:07.667926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:07.676255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e349ed6-8136-485d-b8ff-b5f1248f0e3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080437 May 16 17:12:07.676853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 683/1675] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:07.691265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:07.701647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ba2aeb3d-66e4-4075-bc0c-0d30e82ddd66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.157252 May 16 17:12:07.702263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 993/1676] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:07 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:08.487341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:08.488268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:08.494603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:08.495062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:08.495832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:08.496305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:08.524101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e8f61508-7e00-4c6c-8250-7b03246a4852 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041457 May 16 17:12:08.524656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 684/1677] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:08.693338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:08.693903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:08.700064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:08.700508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:08.701259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:08.701702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:08.720389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:08.721006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:08.726728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:08.727182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:08.727953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:08.728388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:08.761536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:08.769041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aea25000-2225-40de-ba05-4efcc79b6eec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079525 May 16 17:12:08.769618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 994/1678] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:08 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:08.852952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:08.860613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-013805d0-23db-4866-9153-ffa5f3360399 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144590 May 16 17:12:08.861214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 685/1679] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:08 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:09.177679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:12:09.177881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:12:09.535602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:09.536507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:09.542344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:09.542819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:09.543577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:09.544002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:09.571620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab507628-3d55-4c35-b11e-212bc5ebe5af tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039943 May 16 17:12:09.572158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 995/1680] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:09.786095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:09.786703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:09.792857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:09.793304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:09.794225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:09.794668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:09.877669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:09.878317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:09.884380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:09.884829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:09.885596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:09.886062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:09.912937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:09.920571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b0633c87-185e-41bb-bc96-6c5f9256fb10 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.138494 May 16 17:12:09.921245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 686/1681] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:10.014223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:10.021892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b25d6594-8c67-4eec-8331-be498dbd787d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148938 May 16 17:12:10.022456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 996/1682] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:09 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:10.583729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:10.584649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:10.590892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:10.591346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:10.592105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:10.592535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:10.620792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e9bdb773-62cf-4181-8fff-d12619acd987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 May 16 17:12:10.621331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 687/1683] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:10.938264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:10.938874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:10.945173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:10.945610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:10.946395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:10.946822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:11.006723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:11.014084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-27f23988-67e4-4073-a7db-2f9b2fd3f118 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080231 May 16 17:12:11.015045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 997/1684] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:11.039333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:11.039950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:11.046218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:11.046670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:11.047512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:11.047955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:11.171107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:11.179417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-49f493df-5dac-4722-8c3d-4d6038da7b9b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143961 May 16 17:12:11.179980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 688/1685] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:11 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:11.632641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:11.633551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:11.639416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:11.639858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:11.640732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:11.641049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:11.668869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6cb923a1-29f8-4775-ae61-7350164f4b65 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040159 May 16 17:12:11.669424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 998/1686] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:12.031996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:12.032546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:12.038482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:12.038937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:12.039705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:12.040245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:12.102283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:12.109569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fedf0a56-dba3-4b3c-9206-381118f1666c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081544 May 16 17:12:12.110327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 689/1687] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:12.196723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:12.197331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:12.203799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:12.204246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:12.204999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:12.205427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:12.328441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:12.336055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9bc55083-b9a8-447b-9562-604b9affe3f1 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143054 May 16 17:12:12.336605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 999/1688] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:12 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:12.680708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:12.681649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:12.687559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:12.688017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:12.688789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:12.689234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:12.717686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-16a0e96a-c9bc-4472-92fe-18a9e79c05f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 May 16 17:12:12.718258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 690/1689] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:13.127122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:13.127728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:13.133619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:13.134089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:13.134841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:13.135267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:13.198855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:13.207135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c4e5b6de-a27a-44a8-a6e6-cd1efcca578d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084413 May 16 17:12:13.207705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1000/1690] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:13.353880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:13.354499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:13.361237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:13.361690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:13.362479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:13.362919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:13.499183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:13.504601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c0d580dc-fb3e-4e04-b87f-30ba8efbd6f6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.154533 May 16 17:12:13.505192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 691/1691] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:13 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:13.733341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:13.734200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:13.740857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:13.741302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:13.742187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:13.742620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:13.770003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e57462e2-1f67-47db-966b-54aade2b4612 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040642 May 16 17:12:13.770550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1001/1692] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:14.224834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:14.225481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:14.231346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:14.231798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:14.232563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:14.232997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:14.291332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:14.298496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4393e9e8-6b2a-4aba-8d82-1e7dffad8c74 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.077553 May 16 17:12:14.299061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 692/1693] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:14.522507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:14.523037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:14.528993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:14.529439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:14.530221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:14.530656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:14.654156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:14.661762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33e314a7-d957-450c-92b4-671316d009d0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143162 May 16 17:12:14.662344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1002/1694] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:14 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:14.781718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:14.782605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:14.789017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:14.789473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:14.790270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:14.790711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:14.819991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-191be48d-afd2-4348-bbd5-c23b31bf4557 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 May 16 17:12:14.820549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 693/1695] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:15.315387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:15.316002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:15.321835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:15.322284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:15.323047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:15.323482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:15.382487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:15.389588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d17d95ff-24ac-45a8-b76b-415c446a672e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078103 May 16 17:12:15.390184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1003/1696] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:15.678919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:15.679537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:15.685567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:15.686048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:15.686815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:15.687253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:15.810648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:15.818360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-240f6dee-ff71-41e0-ba40-ea1d0e6c6153 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143555 May 16 17:12:15.818928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 694/1697] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:15 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:15.831912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:15.832833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:15.839059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:15.839766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:15.840566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:15.841002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:15.869064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9cd2ec96-fd65-44b7-8d05-c19cba38361a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 May 16 17:12:15.869610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1004/1698] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:16.406662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:16.407295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:16.413783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:16.414241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:16.415026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:16.415459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:16.480259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:16.488082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4d306f2d-c658-484c-8484-274281d6113e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.085487 May 16 17:12:16.488631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 695/1699] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:16.836143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:16.836785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:16.843250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:16.844214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:16.844978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:16.845413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:16.881112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:16.882485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:16.889349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:16.889843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:16.890637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:16.891075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:16.920727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f0f116e-893a-4123-81ff-7e0694a3d3bd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 May 16 17:12:16.921303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 696/1700] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:16.980683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:16.991799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b830891-b55f-49e1-bfee-b39b12ec79d4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.159403 May 16 17:12:16.992393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1005/1701] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:16 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:17.505331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:17.505976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:17.511869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:17.512315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:17.513073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:17.513505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:17.572541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:17.580290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dfe4fe1c-f1e2-461a-93ec-112489342b30 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078913 May 16 17:12:17.580861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 697/1702] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:17.932524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:17.933468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:17.941666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:17.942284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:17.944026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:17.944500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:17.972562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-48932167-47ae-427b-a9f6-4b7c2d3f62de tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 May 16 17:12:17.973110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1006/1703] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:18.008531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:18.009151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:18.015396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:18.015865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:18.016622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:18.017054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:18.141060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:18.148808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d65efacc-4270-4387-bbb5-d0df1c07baa3 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144106 May 16 17:12:18.149374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 698/1704] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:18 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:18.598424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:18.599035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:18.604838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:18.605283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:18.606078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:18.606508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:18.665710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:18.673025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d5983f13-4037-4c27-a8cd-b291ad88d313 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079013 May 16 17:12:18.673593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1007/1705] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:18.984254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:18.985101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:18.991047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:18.991495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:18.992254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:18.992685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:19.022704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-93c9f199-c978-4841-8426-1d800fec47c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 May 16 17:12:19.023246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 699/1706] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:19.165843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:19.166455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:19.172720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:19.173163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:19.173964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:19.174403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:19.299119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:19.306703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-78f30450-4e68-4096-aab0-d9d758754638 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144744 May 16 17:12:19.307275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1008/1707] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:19 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:19.690124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:19.690738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:19.696663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:19.697116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:19.697991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:19.698433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:19.758361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:19.766325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-173b7074-532b-46a1-8fef-c12710566b85 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080131 May 16 17:12:19.766943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 700/1708] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:20.037258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:20.038182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:20.045142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:20.045626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:20.046422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:20.046896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:20.079144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-76fdbb61-f52e-4756-8ca9-0b07658339ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 May 16 17:12:20.079704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1009/1709] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:20.323777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:20.324311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:20.330561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:20.331012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:20.331781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:20.332220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:20.460050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:20.468354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a0b2a1b5-91f7-4422-9b9e-0fe745b376c9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148433 May 16 17:12:20.469534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 701/1710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:20 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:20.783716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:20.784332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:20.790568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:20.791021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:20.791790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:20.792228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:20.855710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:20.862953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cfc75bbe-1344-4e0a-8856-abd4611e0da7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.083621 May 16 17:12:20.863529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1010/1711] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:20 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:21.091223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:21.092158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:21.098617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:21.099074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:21.099852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:21.100295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:21.128280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-644dbfc1-2f71-4d0a-8da8-95bd87b0502b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 May 16 17:12:21.128842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 702/1712] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:21.485769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:21.486373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:21.492255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:21.492699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:21.493448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:21.493909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:21.616825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:21.624422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c1e02821-b06c-4acd-8ae4-135c75b68dda tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.142572 May 16 17:12:21.625609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1011/1713] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:21 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:21.880413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:21.881032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:21.887328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:21.887780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:21.888545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:21.888984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:21.948765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:21.956481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d98b539b-965b-49e1-8431-9ec8b2265471 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079915 May 16 17:12:21.957052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 703/1714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:22.139812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:22.140672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:22.146867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:22.147308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:22.148058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:22.148490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:22.177215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c33069ef-db97-4b81-9714-fdb623dc39f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 May 16 17:12:22.177785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1012/1715] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:22.642581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:22.643196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:22.648997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:22.649452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:22.650245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:22.650685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:22.778724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:22.786498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6662a28e-a577-4dc2-9a0a-ac6c40ad3a66 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148543 May 16 17:12:22.787068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 704/1716] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:22 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:22.973036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:22.973647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:22.979543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:22.979939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:22.980698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:22.981131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:23.040116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:23.048929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4ba430a2-fd1d-42c2-98dd-dea15fbf79d7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079308 May 16 17:12:23.049994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1013/1717] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:23.189514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:23.190491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:23.196759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:23.197207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:23.198008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:23.198444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:23.226630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6d6d7076-b656-4cbc-827f-f592c7941d66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 May 16 17:12:23.227189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 705/1718] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:23.803876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:23.804437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:23.810729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:23.811175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:23.811951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:23.812380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:23.943652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:23.951270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8b9477e5-8f38-476e-87d7-99381e53e31d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151286 May 16 17:12:23.951844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1014/1719] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:23 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:24.066302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:24.066866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:24.072703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:24.073152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:24.073945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:24.074406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:24.134265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:24.141935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dbb7854c-e14c-4bfe-8717-b8796496c7f7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079549 May 16 17:12:24.142495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 706/1720] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:24.238175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:24.239101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:24.245016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:24.245467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:24.246259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:24.246700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:24.275087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9892c004-3fd0-4d69-88cf-a30012b3b41b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040992 May 16 17:12:24.275646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1015/1721] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:24.969154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:24.969789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:24.976065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:24.976518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:24.977289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:24.977727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:25.103086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:25.111597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c47acbff-0b25-48ab-a058-ffe925c409d8 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146850 May 16 17:12:25.112177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 707/1722] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:24 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:25.159187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:25.159800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:25.166033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:25.166481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:25.167237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:25.167703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:25.227067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:25.234989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1afdbd23-5d58-4fb8-87df-ea8f25c687e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079499 May 16 17:12:25.235558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1016/1723] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:25.286365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:25.287328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:25.293136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:25.293592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:25.294401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:25.294870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:25.324466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3ac00ab3-a284-455a-8c68-32f8a89a2906 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 May 16 17:12:25.325018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 708/1724] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:26.128552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:26.129157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:26.135057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:26.135495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:26.136276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:26.136702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:26.251221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:26.251837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:26.258368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:26.258624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:26.259399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:26.259839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:26.260748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:26.269058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-00034694-a9ce-4406-ae5f-93ecbcfc5993 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144347 May 16 17:12:26.269715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1017/1725] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:26 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:26.320336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:26.327729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e766794-cd78-46a0-a159-1e332b067958 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080393 May 16 17:12:26.328815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 709/1726] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:26.336262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:26.337235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:26.343334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:26.344347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:26.345102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:26.345537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:26.373228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7ce066a8-8339-4ba4-81e1-ed6f4bdf763c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040805 May 16 17:12:26.373803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1018/1727] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:27.286252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:27.286800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:27.293055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:27.293505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:27.294297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:27.294737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:27.344669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:27.345287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:27.351553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:27.352017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:27.352766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:27.353197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:27.418028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:27.423800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:27.425605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-27d676fc-cae0-4110-8028-4b094dcc0697 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084758 May 16 17:12:27.426245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1019/1728] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:27.430878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:27.431784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fb2c6feb-dd42-45a9-8bab-c2f189da2073 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149496 May 16 17:12:27.431917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:27.434473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 710/1729] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:27 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:27.438313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:27.438763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:27.439554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:27.439986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:27.468351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1e600624-18cd-4c1c-ad6b-e9d7b51de8c5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 May 16 17:12:27.468935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1020/1730] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:28.443255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:28.443867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:28.448077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:28.448679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:28.450228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:28.450675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:28.451819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:28.451942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:28.454869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:28.455315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:28.456064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:28.456489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:28.519463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:28.527305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9a36a467-310d-4710-8111-58938050d87a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.087661 May 16 17:12:28.527889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 711/1731] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:28.532479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:28.533422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:28.539290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:28.539595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:28.540372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:28.540810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:28.570498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f04cb8fc-d028-404d-9714-cf85743fc7aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 May 16 17:12:28.571064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 712/1732] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:28.588339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:28.596360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3145811f-0283-4ed4-ba9d-4ec61e538a2f tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.152067 May 16 17:12:28.596927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1021/1733] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:28 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:29.544211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:29.544833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:29.551222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:29.551678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:29.552446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:29.552884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:29.582474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:29.583422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:29.590052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:29.590504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:29.591275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:29.591710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:29.612885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:29.620256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-639e9902-0547-46c8-bb85-aa4ec5d448ac tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079903 May 16 17:12:29.620738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-877808a1-28cc-4d02-af43-1c5635f62c0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 May 16 17:12:29.620872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 713/1734] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:29.621456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1022/1735] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:29.625803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:29.626479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:29.632000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:29.632462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:29.633232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:29.633675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:29.760055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:29.772326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8079176f-465d-4753-b6ea-ced903b57d6c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150524 May 16 17:12:29.772919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 714/1736] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:29 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:30.631942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:30.632856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:30.637253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:30.638138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:30.639163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:30.639602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:30.640360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:30.640790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:30.644410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:30.644868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:30.645649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:30.646116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:30.668392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0a9fb30d-946c-470c-b66e-71b4e031aa05 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040365 May 16 17:12:30.668954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1023/1737] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:30.707541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:30.715070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9bd652f7-8087-4e0a-bdf3-8837e1f58729 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081642 May 16 17:12:30.715641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 715/1738] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:30.790566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:30.791169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:30.797498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:30.798053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:30.798802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:30.799227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:30.922594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:30.930284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f53b7403-6a76-45fd-8dc0-2faf7cd19b06 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143542 May 16 17:12:30.930846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1024/1739] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:30 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:31.680577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:31.681427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:31.688288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:31.688827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:31.689598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:31.690061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:31.718013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ad8d42da-e85d-4aff-88de-32613b29e9aa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 May 16 17:12:31.719054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 716/1740] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:31.731721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:31.732338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:31.739213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:31.739660 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:31.740423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:31.740852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:31.802260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:31.809362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-22c00c36-12de-4663-9516-6975b5bcb4c4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081497 May 16 17:12:31.809965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1025/1741] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:31 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:31.948782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:31.949338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:31.955269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:31.955720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:31.956488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:31.956934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:32.084409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:32.092578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-03b63169-e250-49f1-865a-08edc4ee698b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147745 May 16 17:12:32.093153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 717/1742] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:31 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:32.729243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:32.730113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:32.735941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:32.736536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:32.737141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:32.737572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:32.766292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1bd835d1-8c94-4f03-8d5f-50194aa0445d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 May 16 17:12:32.766851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1026/1743] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:32.826237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:32.826879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:32.833150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:32.833603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:32.834408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:32.834845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:32.897381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:32.904662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-39b801f7-1354-4db1-80ed-a7c1e08c6742 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082298 May 16 17:12:32.905229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 718/1744] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:33.110661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:33.111262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:33.117015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:33.117456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:33.118238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:33.118663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:33.242458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:33.250018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8f3fe54b-e316-483c-8592-28cb3bc5728d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143682 May 16 17:12:33.250697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1027/1745] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:33 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:33.778433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:33.779269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:33.785713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:33.786194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:33.786961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:33.787398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:33.814795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3becd0a2-6553-4436-b1bc-76228ac3ac4f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 May 16 17:12:33.815343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 719/1746] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:33.921503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:33.922142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:33.928366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:33.928811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:33.929572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:33.930034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:33.994159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:34.001994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4cb3fea6-db6e-4f28-b5bf-80857a8b1fb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084249 May 16 17:12:34.002558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1028/1747] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:34.268014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:34.268631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:34.278608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:34.279418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:34.280754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:34.281506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:34.405648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:34.413612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-acb4daaa-10d7-4c5b-a9aa-7cba37381915 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150038 May 16 17:12:34.414281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 720/1748] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:34 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:34.826179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:34.827100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:34.834270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:34.834715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:34.835475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:34.835910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:35.019398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:35.020021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:35.023976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da012046-62c3-49eb-83d6-d5eb3dd96c16 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201661 May 16 17:12:35.024612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1029/1749] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:34 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:35.025840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:35.026301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:35.027083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:35.027522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:35.087317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:35.095392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-387f426c-92ce-4019-9762-dda1e2015377 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080387 May 16 17:12:35.095959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 721/1750] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:35.431307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:35.431957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:35.438358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:35.438803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:35.439561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:35.439993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:35.578788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:35.586445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4b8ccb23-09c9-4901-a2b2-7fbbdde7faa9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.159072 May 16 17:12:35.587004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1030/1751] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:35 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:36.036241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:36.037158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:36.043470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:36.043955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:36.044723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:36.045163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:36.072872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-910d0a53-b0ac-4f1e-b905-b270a27157df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040594 May 16 17:12:36.073431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 722/1752] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:36.112344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:36.112962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:36.119150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:36.119595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:36.120361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:36.120796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:36.179037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:36.186214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4c2abfd4-e659-4209-a3a3-faf57d267bcb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078002 May 16 17:12:36.186773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1031/1753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:36.603543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:36.604154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:36.610019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:36.610466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:36.611225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:36.611943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:36.737018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:36.744671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fb067c9b-1a6d-48a7-9e59-17a4b9747ed5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144968 May 16 17:12:36.745236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 723/1754] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:36 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:37.197529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:37.198537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:37.204856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:37.205296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:37.205451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:37.205615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:37.206251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:37.206690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:37.211875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:37.212323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:37.213111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:37.213543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:37.236186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2d270267-e99e-48cc-999b-38ba8b662970 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155171 May 16 17:12:37.237043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1032/1755] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:37.276526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:37.283827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ffe664ec-3854-42f9-997e-867d6e0a2666 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.083314 May 16 17:12:37.284332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 724/1756] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:37.761272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:37.761914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:37.768407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:37.768858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:37.769619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:37.770080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:37.892462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:37.900101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2c65de93-52ab-48c3-af33-0b2e31a1e0ee tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.142712 May 16 17:12:37.900662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1033/1757] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:37 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:38.247762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:38.248689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:38.255056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:38.255510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:38.256282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:38.256727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:38.285292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-48aec932-c1e5-4251-9e2f-93a4da2f0acf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041656 May 16 17:12:38.285871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 725/1758] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:38.300154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:38.300763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:38.307062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:38.307515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:38.308276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:38.308721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:38.371963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:38.379155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e4729e18-492f-468f-91c9-ee3cf01a93ec tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082830 May 16 17:12:38.379711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1034/1759] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:38.916465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:38.917079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:38.922977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:38.923423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:38.924177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:38.924609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:39.046466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:39.054099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dbb14a80-4e12-4742-b0e7-11bd55eeaefc tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.141485 May 16 17:12:39.054661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 726/1760] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:38 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:39.296686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:39.297584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:39.303458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:39.304029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:39.304636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:39.305065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:39.335544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3bcfdf84-6ecb-4b9c-9b8f-5b51b798b31c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 May 16 17:12:39.336074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1035/1761] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:39.396338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:39.396956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:39.403268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:39.403723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:39.404489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:39.404932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:39.469141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:39.476559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-941fcf58-8926-49fc-baa6-0fede615533d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084032 May 16 17:12:39.477159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 727/1762] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:40.070721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:40.071339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:40.077159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:40.077698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:40.078492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:40.078932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:40.200972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:40.208575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-25c774fa-49aa-493a-ac3e-5f56f3779494 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.141695 May 16 17:12:40.209136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1036/1763] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:40 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:40.347960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:40.348886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:40.354963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:40.355411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:40.356170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:40.356598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:40.384281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f305241c-8cc5-49f6-b93a-081226e5c1f0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041009 May 16 17:12:40.384827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 728/1764] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:40.493453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:40.494093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:40.500929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:40.501374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:40.502178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:40.502612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:40.561586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:40.569430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8c3a5cbe-8a1f-4a41-b800-e84381db783f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079875 May 16 17:12:40.570022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1037/1765] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:41.226316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:41.226845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:41.233106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:41.233553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:41.234875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:41.235312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:41.359635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:41.367330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8428c254-34a9-4640-98a1-e06aabe1aa83 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144969 May 16 17:12:41.367902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 729/1766] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:41 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:41.395601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:41.396527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:41.402295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:41.402751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:41.403550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:41.403991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:41.432322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-211e6fde-7b19-4171-81c9-40e2f83a1620 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040595 May 16 17:12:41.432871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1038/1767] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:41 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:41.585596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:41.586254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:41.592357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:41.592806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:41.594089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:41.594518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:41.653281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:41.661001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-383474e8-63f4-4aed-9125-db9c353a5652 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079343 May 16 17:12:41.661573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 730/1768] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:42.384900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:42.385517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:42.392569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:42.393020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:42.393817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:42.394259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:42.444186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:42.445105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:42.451404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:42.451849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:42.453283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:42.453718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:42.483626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5eee2bb1-0f2a-4991-8520-4b7c23da422e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 May 16 17:12:42.484225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 731/1769] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:42.523990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:42.535966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b4a8ca6b-885b-44f5-94d0-a10135291e0c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.154785 May 16 17:12:42.536565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1039/1770] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:42 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:42.677331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:42.677905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:42.683735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:42.684186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:42.684951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:42.685388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:42.748262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:42.755585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0d5f9fa8-588f-4951-9dfa-72c0b148f13f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082170 May 16 17:12:42.756154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 732/1771] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:42 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:43.495292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:43.496212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:43.503466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:43.503914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:43.504685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:43.505116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:43.533121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b6c7f32c-f2cc-45cd-830f-82db46094265 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041772 May 16 17:12:43.533678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1040/1772] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:43.553353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:43.554340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:43.563807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:43.565538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:43.565538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:43.565823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:43.691118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:43.699182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-afbb13d5-9c22-49b3-a3c2-f695559ee9a9 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150316 May 16 17:12:43.699745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 733/1773] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:43 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:43.772027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:43.772665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:43.778409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:43.778847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:43.779612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:43.780027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:43.839376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:43.847344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a5a0f5ed-4816-4be1-8f12-36b5bed83510 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079021 May 16 17:12:43.847917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1041/1774] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:44.544791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:44.545722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:44.551645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:44.552099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:44.552872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:44.553314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:44.582746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f37dc8f-acf5-4e1e-9874-696d9770fd56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042000 May 16 17:12:44.583632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 734/1775] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:44.716377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:44.716926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:44.722899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:44.723347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:44.724107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:44.724913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:44.848448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:44.856126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-357deb42-ab73-40bf-ab96-054a4cb30b9a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143989 May 16 17:12:44.856685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1042/1776] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:44 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:44.865835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:44.866463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:44.872312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:44.872767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:44.873540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:44.874017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:44.933277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:44.941683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fc60758b-5277-4d8e-895f-49203ae41043 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079728 May 16 17:12:44.942279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 735/1777] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:45.594888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:45.595818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:45.602030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:45.602486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:45.603262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:45.603700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:45.631259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61b8d6f4-3d3d-419c-9c3c-9095c90b66e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040971 May 16 17:12:45.631811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1043/1778] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:45.872610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:45.873229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:45.879176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:45.879625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:45.880398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:45.880834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:45.958923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:45.959610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:45.966024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:45.966475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:45.967243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:45.967676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:46.014486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:46.023257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-39a23491-5454-4ab2-93c0-34d7c5ba366c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.154589 May 16 17:12:46.023838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 736/1779] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:45 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:46.038445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:46.045896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d8b7863-4048-4369-a875-bdbc3812e5bc tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.090747 May 16 17:12:46.046463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1044/1780] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:46.643569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:46.644480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:46.650378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:46.650851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:46.651605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:46.652036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:46.680179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-83be7563-9f59-45c3-8937-4ffb1935a5f3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 May 16 17:12:46.680668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 737/1781] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:47.040202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:47.040823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:47.047708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:47.048163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:47.048933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:47.049373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:47.062602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:47.063220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:47.069491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:47.069983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:47.070752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:47.071189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:47.131545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:47.139048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ee6a7669-759d-48fc-8498-db77fa7242e7 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080259 May 16 17:12:47.139633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 738/1782] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:47.175641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:47.183375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4b03c12a-cb64-4c98-8a82-7fa5d30db3f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147058 May 16 17:12:47.183945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1045/1783] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:47 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:47.692291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:47.693134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:47.699090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:47.699538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:47.700301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:47.700736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:47.729175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3486b0d6-96d3-4fc3-8666-36983f3d960e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 May 16 17:12:47.729725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 739/1784] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:48.156301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:48.156917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:48.163216 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:48.163658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:48.164438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:48.164854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:48.200563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:48.201170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:48.207996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:48.208440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:48.209226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:48.209658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:48.229537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:48.237457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-560d2e7f-9702-417b-8500-99bc32f69af5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.085067 May 16 17:12:48.238058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1046/1785] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:48 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:48.339667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:48.347813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-104c2a4a-dbf3-4230-8d2c-337a842cb7cf tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151202 May 16 17:12:48.348378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 740/1786] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:48 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:48.740085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:48.740916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:48.746789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:48.747237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:48.747997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:48.748432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:48.775985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1ebe7582-7747-44f0-bc62-9beeaed11c76 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040016 May 16 17:12:48.776562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1047/1787] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:49.254021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:49.254635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:49.260860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:49.261312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:49.262101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:49.262536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:49.326370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:49.333593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8aa073ac-decb-4092-b39b-c80b614bfb3e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084082 May 16 17:12:49.334176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 741/1788] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:49 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:49.364937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:49.365577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:49.371752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:49.372197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:49.372952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:49.373382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:49.499331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:49.507609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5f176076-7547-4376-bb14-2f69bb2659c0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146471 May 16 17:12:49.508176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1048/1789] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:49 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:49.788106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:49.789019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:49.794864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:49.795311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:49.796099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:49.796531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:49.825013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0afaa84d-ba51-4d49-bf55-029332954c0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 May 16 17:12:49.825557 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 742/1790] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:50.350433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:50.351045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:50.356878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:50.357326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:50.358120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:50.358558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:50.417783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:50.425156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e099351c-b10e-41c4-a613-82e4d79ef2e4 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078569 May 16 17:12:50.425718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1049/1791] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:50 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:50.526545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:50.527178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:50.533572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:50.534068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:50.534851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:50.535297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:50.660194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:50.667857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d262fb1e-6786-4f17-9209-49e70b0716f2 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145227 May 16 17:12:50.668426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 743/1792] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:50 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:50.836455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:50.837378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:50.843458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:50.843915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:50.844696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:50.845133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:50.876400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a7a3085b-aac3-42e3-afd5-5a371db15eee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 May 16 17:12:50.877135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1050/1793] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:51.442099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:51.442652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:51.448781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:51.449227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:51.450014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:51.450443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:51.511089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:51.518918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-595170dd-32c4-4bf1-b7d0-a2fc2f221216 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080837 May 16 17:12:51.519482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 744/1794] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:51 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:51.686115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:51.686728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:51.693625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:51.694045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:51.694808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:51.695245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:51.819800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:51.827442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3a1558c6-f9d9-4d83-b1d8-103b9998ae3b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145163 May 16 17:12:51.828004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1051/1795] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:51 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:51.888227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:51.889143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:51.895341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:51.895787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:51.896541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:51.896972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:51.926028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3177a856-e870-4499-96d8-796a060288e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 May 16 17:12:51.927031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 745/1796] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:52.535769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:52.536374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:52.542295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:52.542741 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:52.543488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:52.543917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:52.607246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:52.614505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4af95657-0ef3-4494-ba85-e52808066b1f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.083168 May 16 17:12:52.615065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1052/1797] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:52 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:52.845512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:52.846165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:52.852003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:52.852452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:52.853205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:52.853636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:52.937663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:52.938606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:52.944796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:52.945237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:52.946043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:52.946468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:52.974983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4969ccf4-27e1-41e7-bc1b-3f08627cdb00 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 May 16 17:12:52.975545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1053/1798] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:52.980996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:52.989472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-87aac638-37f5-4fcd-8547-c7dd3e69d767 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148760 May 16 17:12:52.990083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 746/1799] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:52 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:53.631941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:53.632546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:53.638466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:53.638917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:53.639675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:53.640107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:53.699263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:53.707057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-842f032f-4ecb-4672-a89c-0b9632451fed tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078953 May 16 17:12:53.707623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1054/1800] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:53 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:53.986930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:53.987768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:53.995207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:53.995654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:53.996421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:53.996857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:54.007289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:54.007811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:54.014607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:54.015146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:54.015931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:54.016428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:54.026921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7573e4e3-6009-4a56-992a-d8dbbb91cfbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 May 16 17:12:54.027482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 747/1801] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:54.148955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:54.157284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-19233a25-ec9b-467c-bef8-547b78e17e9d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.153443 May 16 17:12:54.157880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1055/1802] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:54 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:12:54.725078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:54.725614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:54.731626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:54.732092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:54.732833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:54.733265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:54.792468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:54.800051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7366cdc-9f27-4ae6-b372-cf0610e9d32f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079229 May 16 17:12:54.800621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 748/1803] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:54 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:55.038495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:55.039442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:55.045643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:55.046117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:55.046871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:55.047329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:55.074918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-88b4ff4a-567a-43de-b79a-fcc5351677b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040391 May 16 17:12:55.075457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1056/1804] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:55.173536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:55.174175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:55.180357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:55.180809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:55.181569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:55.182033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:55.314590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:55.322274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb4bd8f6-b894-4bc2-88c3-b43fc34d8452 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.152651 May 16 17:12:55.322846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 749/1805] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:55 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:55.816353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:55.816961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:55.823017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:55.823462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:55.824220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:55.824654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:55.884114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:55.891672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1ae98814-d08a-4142-9803-6b2d5d21bd86 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079159 May 16 17:12:55.892435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1057/1806] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:55 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:56.086794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:56.087758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:56.094957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:56.095641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:56.096422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:56.096869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:56.125703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e9d69df7-95c8-4cd4-b79a-95e82bf23746 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042968 May 16 17:12:56.126292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 750/1807] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:56.339448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:56.339977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:56.347052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:56.347540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:56.348327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:56.348765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:56.475843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:56.483523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4ec58628-a120-4df9-830f-1a1c7ccacc23 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148332 May 16 17:12:56.484086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1058/1808] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:56 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:56.908407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:56.909030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:56.915308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:56.915771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:56.916543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:56.916989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:56.978429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:56.986186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f6db3918-8bf4-4d35-a631-db26f06513d3 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081600 May 16 17:12:56.986761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 751/1809] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:56 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:57.136539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:57.137509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:57.143364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:57.143814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:57.144573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:57.145012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:57.173369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab3314e6-0ad9-43c3-bcc7-b42b3992bf35 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040738 May 16 17:12:57.173960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1059/1810] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:57.500939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:57.501554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:57.507529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:57.507978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:57.508749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:57.509188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:57.637543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:57.645337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8bd14621-9183-453e-847c-ee7ddf8f8359 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148850 May 16 17:12:57.645931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 752/1811] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:57 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:58.002882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:58.003486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:58.009708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:58.010192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:58.010947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:58.011388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:58.072104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:58.079416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8832144f-8f33-4492-9c71-893f7672a28f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080382 May 16 17:12:58.079979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1060/1812] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:57 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:58.184913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:58.185847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:58.192098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:58.192546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:58.193539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:58.193996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:58.222851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5af3cae4-8f22-4024-b427-b4968f12d7e8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 May 16 17:12:58.223427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 753/1813] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:12:58.662929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:58.663556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:58.669406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:58.669891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:58.670655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:58.671094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:58.797648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:58.805255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-746dade7-d6de-4434-aab9-0576faf944cb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146191 May 16 17:12:58.805870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1061/1814] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:58 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:59.095900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:59.096516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:59.102675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:59.103123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:59.103876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:59.104308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:59.236934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:59.237915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:59.244324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:59.244773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:59.245547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:59.246019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:59.258781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:59.266195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-24e349d8-dbfe-4170-a30a-d2324187adde tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.174091 May 16 17:12:59.266765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 754/1815] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:59 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:12:59.275881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5b9ea862-6d64-4c17-af2e-2662b086709b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 May 16 17:12:59.276435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1062/1816] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:12:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:12:59.822754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:12:59.823289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:12:59.829274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:59.829730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:59.830522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:12:59.830960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:12:59.957464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:12:59.965484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-02a7948c-16ea-42ed-b681-45f34cb9ae8a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146741 May 16 17:12:59.966079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 755/1817] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:12:59 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:00.283348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:00.283969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:00.286894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:00.287890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:00.290793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:00.291314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:00.292078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:00.292511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:00.294506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:00.294954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:00.295725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:00.296166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:00.326075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8ca8ba08-6b9b-4b6d-b16a-e41fe3dcc170 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 May 16 17:13:00.326649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 756/1818] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:00.353125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:00.360734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-49fa4298-1a91-4645-989f-6d7c76d873a5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081357 May 16 17:13:00.361288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1063/1819] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:00 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:00.986103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:00.987216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:00.995348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:00.995801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:00.996579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:00.997015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:01.121705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:01.129516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f864d52b-ac19-4317-8dbf-edd8ca795b88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150182 May 16 17:13:01.130129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 757/1820] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:00 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:01.338581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:01.339756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:01.347081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:01.347570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:01.348332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:01.348882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:01.377911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5c710ca8-6e28-443c-8a2f-e9f29b61c3d9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 May 16 17:13:01.378471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1064/1821] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:01.380897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:01.381518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:01.392462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:01.392916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:01.393698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:01.394160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:01.465879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:01.474679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-669a6be4-5323-4c20-9d85-0ff1a3a191b1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.097590 May 16 17:13:01.475257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 758/1822] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:01 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:02.146613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:02.147233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:02.153064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:02.153519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:02.154314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:02.154748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:02.277355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:02.285041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a8924969-02a5-47f1-8242-2d705bffc5c6 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.142255 May 16 17:13:02.285610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1065/1823] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:02 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:02.388759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:02.389761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:02.396778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:02.397149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:02.397964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:02.398412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:02.427908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c6e354e3-8a8f-4aff-abb7-e73e04ab8c59 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 May 16 17:13:02.428474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 759/1824] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:02.495395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:02.496033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:02.502250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:02.502699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:02.503452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:02.503887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:02.563813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:02.570920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ec1df2c1-985d-489e-ad47-e4c38c398202 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079361 May 16 17:13:02.571483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1066/1825] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:02 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:03.302214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:03.302749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:03.308651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:03.309109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:03.309907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:03.310350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:03.434781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:03.440527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:03.441445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:03.442717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aebb2db3-8e84-4271-b29e-ae779bc4b541 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144467 May 16 17:13:03.443293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 760/1826] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:03 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:03.447233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:03.447681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:03.448442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:03.448871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:03.477085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a9bdf7c4-5274-4fd6-98dd-6bbf24871ef7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 May 16 17:13:03.477637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1067/1827] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:03.588272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:03.589149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:03.595764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:03.596210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:03.596967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:03.597397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:03.655409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:03.663234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ec36e4a8-520b-4ce8-ba76-94cca355f1f6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078905 May 16 17:13:03.663794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 761/1828] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:03 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:04.459956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:04.460573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:04.467167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:04.467613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:04.468377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:04.468921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:04.488991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:04.489937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:04.495882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:04.496332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:04.497097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:04.497533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:04.527930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-66481b2d-ba32-4e47-bac0-1ce9935dc548 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 May 16 17:13:04.528500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 762/1829] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:04.601326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:04.608974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-568f847d-5809-47fd-ae0e-e27cfa002135 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.152928 May 16 17:13:04.610074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1068/1830] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:04 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:04.679794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:04.680352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:04.686191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:04.686639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:04.687398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:04.687833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:04.747476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:04.754720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c71a37a5-63b2-4015-9683-f199b2fde304 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078781 May 16 17:13:04.755287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 763/1831] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:04 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:05.539494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:05.540422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:05.546790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:05.547243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:05.548010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:05.548451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:05.579007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-752b5197-c6ea-47ce-94e3-2e3815f2b53a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 May 16 17:13:05.579564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1069/1832] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:05.626865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:05.627605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:05.633850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:05.634306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:05.635074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:05.635514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:05.762480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:05.770910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e38f7163-a69d-4114-9d80-ffb3725a8b54 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148381 May 16 17:13:05.771479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 764/1833] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:05 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:05.771798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:05.772424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:05.778207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:05.778663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:05.779427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:05.779861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:05.840059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:05.847395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4233efcc-94f7-46d9-a890-eb7684cadb5a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079344 May 16 17:13:05.847957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1070/1834] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:05 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:06.591251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:06.592170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:06.598163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:06.598613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:06.599366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:06.599795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:06.628664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-be39efc3-3c1d-45f7-9426-298abf162323 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041630 May 16 17:13:06.629303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 765/1835] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:06.787843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:06.788385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:06.794638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:06.795091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:06.795861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:06.796321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:06.864782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:06.865404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:06.871661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:06.872114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:06.873337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:06.873337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:06.927380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:06.934429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:06.935193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c4cb1c93-5822-4561-8db6-25a3313f6d88 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151239 May 16 17:13:06.935763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1071/1836] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:06 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:06.941858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0de983f3-407f-4285-8c64-33514a242bb6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081026 May 16 17:13:06.942418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 766/1837] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:06 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:07.640195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:07.641616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:07.647562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:07.648009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:07.648775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:07.649210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:07.677393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a3fd73dd-3cec-44fa-b574-0fa7bebb58e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041100 May 16 17:13:07.677903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1072/1838] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:07.952244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:07.952886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:07.958486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:07.959103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:07.959902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:07.960357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:07.961133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:07.961611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:07.965657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:07.966137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:07.966904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:07.967342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:08.026519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:08.033896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-12d7648e-116d-4480-815e-90e4526b925d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079105 May 16 17:13:08.034472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1073/1839] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:07 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:08.094698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:08.102458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c9e932fa-8259-4061-aa63-ec63ddb046eb tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.154187 May 16 17:13:08.103022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 767/1840] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:07 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:08.688841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:08.689667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:08.695560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:08.696004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:08.696758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:08.697188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:08.725490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fe34a9e0-6704-4d51-8b14-5a707b99b140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040606 May 16 17:13:08.726070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1074/1841] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:09.050738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:09.051353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:09.057585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:09.058064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:09.058821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:09.059258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:09.118758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:09.120162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:09.120770 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:09.126224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-802ff28c-25bf-4aab-8c17-ae661673d257 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079309 May 16 17:13:09.126793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 768/1842] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:09 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:09.127171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:09.127620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:09.128392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:09.128826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:09.252414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:09.260085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f2f7abc-8d8f-44ab-9234-4048e0acd094 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143690 May 16 17:13:09.260653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1075/1843] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:09 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:09.736866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:09.737707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:09.743625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:09.744082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:09.744852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:09.745296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:09.773388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-82437baa-7d92-40a3-ba9b-b652f859aa87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041077 May 16 17:13:09.773972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 769/1844] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:10.143267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:10.143892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:10.150336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:10.150790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:10.151557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:10.152001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:10.215735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:10.223545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f62a29f6-ec68-4ad3-a7e8-8b050f62420d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084131 May 16 17:13:10.224103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1076/1845] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:10 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:10.277445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:10.278092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:10.285045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:10.285732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:10.286633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:10.287221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:10.413077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:10.420969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-04b7d82b-d0b3-41bb-ba3b-a76e6e641934 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147314 May 16 17:13:10.421536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 770/1846] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:10 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:10.785195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:10.786059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:10.791888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:10.792332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:10.793087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:10.793517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:10.822732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33452567-693b-411d-8790-50519244a9f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 May 16 17:13:10.823269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1077/1847] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:11.240315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:11.240923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:11.246805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:11.247248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:11.248005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:11.248434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:11.306979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:11.314163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a92d622d-a694-4133-9dde-8dd0c77cf45f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.077671 May 16 17:13:11.314729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 771/1848] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:11 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:11.438773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:11.439417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:11.445701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:11.446183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:11.446944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:11.447380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:11.573423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:11.581639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f4d52d8-70b7-47b0-a904-f86e6976ab82 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147208 May 16 17:13:11.582233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1078/1849] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:11 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:11.834462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:11.835444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:11.841624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:11.842108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:11.842880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:11.843318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:11.871441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f94fe8cd-0643-47ad-bd13-2a772355333e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041012 May 16 17:13:11.871992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 772/1850] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:12.331700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:12.332308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:12.338205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:12.338915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:12.339668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:12.340098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:12.399682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:12.406916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-68acc83f-6f1b-4bf7-a7b2-ca8673bc0e8e tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079580 May 16 17:13:12.407487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1079/1851] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:12 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:12.599367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:12.599912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:12.606186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:12.606632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:12.607385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:12.607817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:12.738768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:12.746382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1abd4570-e67d-4f92-8880-b2583a609407 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.150894 May 16 17:13:12.746937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 773/1852] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:12 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:12.882983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:12.883832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:12.890093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:12.890552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:12.891863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:12.892304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:12.920499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-04b75de5-2ffa-4f2f-ab07-5f47b335a623 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 May 16 17:13:12.921044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1080/1853] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:13.423590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:13.424203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:13.430062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:13.430509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:13.431266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:13.431697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:13.490367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:13.497506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-01273c76-92d6-490a-9697-a18c86cd1f4b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.077774 May 16 17:13:13.498096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 774/1854] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:13 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:13.762785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:13.763341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:13.769698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:13.770173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:13.770928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:13.771363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:13.902949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:13.910562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-af44c865-d5f4-48ba-985b-888a07b2e257 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151721 May 16 17:13:13.911114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1081/1855] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:13 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:13.933304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:13.934240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:13.940898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:13.941345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:13.942125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:13.942561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:13.971224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9ae40a1a-4fd9-4ed6-be70-ca61b383c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 May 16 17:13:13.971783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 775/1856] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:14.515106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:14.515717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:14.521539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:14.522012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:14.522776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:14.523209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:14.581800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:14.589492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f97da153-46bf-487c-be04-b05ef3cf7b55 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078418 May 16 17:13:14.590096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1082/1857] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:14 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:14.927834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:14.928444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:14.934296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:14.934907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:14.935488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:14.935918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:14.982199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:14.983124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:14.989124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:14.989571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:14.990385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:14.991181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:15.020144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d5396341-aca4-4169-b7ef-c8abb1d0435b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 May 16 17:13:15.020906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1083/1858] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:15.065913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:15.073626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a677e852-ad3f-4085-837e-44db9544e20a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149879 May 16 17:13:15.074225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 776/1859] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:14 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:15.608402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:15.609017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:15.615730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:15.616187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:15.616947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:15.617385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:15.676439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:15.683679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-58f2e5bd-c6e9-4c30-80e8-29191aa9b73a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079216 May 16 17:13:15.684439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1084/1860] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:15 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:16.032055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:16.032897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:16.039173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:16.039626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:16.040387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:16.040821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:16.069218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2388047a-80c9-491b-ae45-f1aebead357f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 May 16 17:13:16.069768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 777/1861] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:16.091142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:16.091750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:16.098438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:16.098881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:16.099636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:16.100069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:16.226095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:16.233897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-00710cab-a97b-4549-90cf-d41418f8b655 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146724 May 16 17:13:16.234468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1085/1862] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:16 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:16.700466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:16.701002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:16.706907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:16.707358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:16.708118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:16.708561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:16.767939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:16.775135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2e4a0a87-82d7-43d2-8984-b528e0d95250 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078658 May 16 17:13:16.775705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 778/1863] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:16 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:17.081050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:17.082004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:17.088446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:17.089169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:17.089967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:17.090403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:17.118675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7859c64d-545a-4388-8aa7-09319b51055e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 May 16 17:13:17.119261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1086/1864] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:17.250829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:17.251443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:17.257845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:17.258334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:17.259102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:17.259540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:17.382172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:17.389990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9742c73c-c4bc-47e9-9cc5-ed8bbfb35443 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.142808 May 16 17:13:17.391056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 779/1865] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:17 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:17.792510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:17.793047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:17.799425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:17.799867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:17.800622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:17.801052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:17.863467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:17.870768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1e9c0570-99e4-4972-8b7c-406591630641 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082169 May 16 17:13:17.871329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1087/1866] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:17 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:18.131356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:18.132285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:18.138233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:18.138693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:18.139467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:18.139908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:18.169147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5b78d813-2196-4c3f-8eb4-0a1da1a4dbcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 May 16 17:13:18.169708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 780/1867] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:18.407314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:18.407944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:18.414241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:18.414668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:18.415431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:18.415860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:18.526378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:13:18.527144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:13:18.540512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:18.548688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f729826a-7803-4826-9ec0-9e55a528a2a0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145310 May 16 17:13:18.549248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1088/1868] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:18 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:18.888081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:18.888693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:18.895190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:18.895641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:18.896403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:18.896839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:18.959378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:18.967045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-656bb700-c3c0-4836-a701-638171ce616f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082809 May 16 17:13:18.967611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 781/1869] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:18 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:19.181300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:19.182255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:19.188095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:19.188541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:19.189297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:19.189760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:19.217193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ca918dd3-92b5-401d-a6b5-a38fd9730de1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039850 May 16 17:13:19.217669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1089/1870] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:19.568889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:19.569412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:19.575259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:19.575704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:19.576467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:19.576902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:19.702552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:19.710815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-00241e2d-45b0-443c-a4c3-743e330516f7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145906 May 16 17:13:19.711412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 782/1871] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:19 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:19.984153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:19.984775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:19.991054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:19.991505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:19.992262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:19.992699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:20.052136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:20.059424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dcfa7490-a03e-4b1e-ad92-677a13635d4d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079116 May 16 17:13:20.059988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1090/1872] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:19 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:20.228566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:20.229485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:20.235850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:20.236239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:20.236991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:20.237421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:20.265151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-694b47e1-56da-4f3a-acf1-1d7c9df97b79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 May 16 17:13:20.266221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 783/1873] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:20.727507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:20.728145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:20.734017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:20.734472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:20.735232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:20.735668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:20.861054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:20.868678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8ad587a3-3f82-4500-ad40-155759a3bb0e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145079 May 16 17:13:20.869246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1091/1874] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:20 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:21.076841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:21.077459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:21.083516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:21.083967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:21.084739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:21.085179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:21.144042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:21.151266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-45e0be3b-066d-43c6-852e-9da9f4b92aa6 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078358 May 16 17:13:21.151832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 784/1875] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:21 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:21.277128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:21.278077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:21.284816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:21.285269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:21.286062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:21.286500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:21.314872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e4361f41-b6ea-481f-bc6a-f31a2d75025e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 May 16 17:13:21.315440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1092/1876] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:21.886211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:21.886824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:21.893666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:21.894135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:21.894895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:21.895326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:22.022948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:22.030596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-500bbe66-6d40-4dd9-9f7c-22a7f4aa7d12 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.148203 May 16 17:13:22.031174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 785/1877] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:21 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:22.168453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:22.168989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:22.174880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:22.175332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:22.176091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:22.176527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:22.237514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:22.244788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-55c50e47-2b4f-4694-959e-0141b994e0e1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080311 May 16 17:13:22.245364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1093/1878] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:22 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:22.326366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:22.327287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:22.333112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:22.333562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:22.334365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:22.334802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:22.362975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d96fc1eb-b6f9-4b88-a071-66bff6132bca tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040527 May 16 17:13:22.363528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 786/1879] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:23.047755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:23.048354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:23.054697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:23.055153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:23.055922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:23.056361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:23.179046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:23.186682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4ccc5aec-c97e-4b12-bed3-4d0e46816e8e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143087 May 16 17:13:23.187251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1094/1880] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:23 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:23.262065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:23.262677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:23.269402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:23.269895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:23.270666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:23.271103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:23.332482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:23.340078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-73a124c3-7b27-4e36-8a5b-8ce4f992246b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081875 May 16 17:13:23.340645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 787/1881] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:23 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:23.374276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:23.375219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:23.380936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:23.381381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:23.382159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:23.382593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:23.411029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b923f37b-e594-450d-90b1-948b636b70cb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040601 May 16 17:13:23.411882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1095/1882] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:24.204508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:24.205151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:24.211164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:24.211617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:24.212391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:24.212833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:24.341262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:24.349400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d005b4dd-5ad0-43bb-8372-c0eac58f5857 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149209 May 16 17:13:24.350282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 788/1883] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:24 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:24.357154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:24.357789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:24.364108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:24.364553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:24.365324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:24.365842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:24.422423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:24.423395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:24.429104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:24.429357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:24.429942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:24.430717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:24.431148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:24.436503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7fed2540-8ff4-45d6-be0c-8d8ddb180c67 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.083224 May 16 17:13:24.437072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1096/1884] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:24 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:24.462046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-73b19fc7-66c6-42a4-85b8-074c4dfc2399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 May 16 17:13:24.462525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 789/1885] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:25.368728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:25.369351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:25.375659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:25.376106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:25.376865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:25.377301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:25.454232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:25.454840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:25.461295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:25.461758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:25.462685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:25.463127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:25.502957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:25.510790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e9425b52-4bbc-4474-b81f-4576c6af46b5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.146447 May 16 17:13:25.511588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1097/1886] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:25 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:25.516584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:25.517501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:25.523337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:25.523795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:25.524573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:25.525019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:25.525392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:25.533443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d3a50cf1-e3f1-4fd3-9797-8ec5965727df tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.083639 May 16 17:13:25.534076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 790/1887] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:25 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:25.553924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0949bfa6-b8a4-4b08-91d2-e9372928c937 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041435 May 16 17:13:25.554485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1098/1888] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:26.528809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:26.529453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:26.535818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:26.536293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:26.537050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:26.537491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:26.550120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:26.550739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:26.556906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:26.557359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:26.558159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:26.558596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:26.619744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:26.627635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a6bf0b38-dd06-4ed0-9c29-b3adc8f7160f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081376 May 16 17:13:26.628204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1099/1889] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:26 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:26.632887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:26.633804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:26.639283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:26.639729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:26.641127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:26.641561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:26.666801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:26.669508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0bb0cd55-c226-4ca7-ae7a-5c0a6e8806ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040115 May 16 17:13:26.670119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1100/1890] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:26.674601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6080dd8f-8337-47e2-ba6a-0c6e682e96f5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.149643 May 16 17:13:26.675161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 791/1891] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:26 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:26.851076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:13:26.851279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:13:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:13:27.644103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:27.644716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:27.651017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:27.651492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:27.652250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:27.652683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:27.680876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:27.681604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:27.688279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:27.688731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:27.689505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:27.689991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:27.712897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:27.719806 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dec92844-d356-4b58-b9e2-21da71cb8cbe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 May 16 17:13:27.720378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 792/1892] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:27.721038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f9d4fc78-5f0a-463b-9416-ec27fb93fb7c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081238 May 16 17:13:27.721800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1101/1893] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:27 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:27.724987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:27.725596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:27.731171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:27.731623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:27.732389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:27.732827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:27.854343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:27.862130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3ce11488-f026-42b8-8077-6e47946773a4 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.140778 May 16 17:13:27.862701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 793/1894] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:27 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:28.731520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:28.732361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:28.738185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:28.738840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:28.739327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:28.739783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:28.740548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:28.740983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:28.745036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:28.745499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:28.746328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:28.746767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:28.769032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0be6c521-558e-4f5b-9cb1-286bdb957081 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 May 16 17:13:28.769599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1102/1895] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:28.810819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:28.818026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b221d3d0-e534-4ff5-bff3-833279ce7b1c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.084184 May 16 17:13:28.818579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 794/1896] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:28 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:28.879074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:28.879761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:28.885824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:28.886275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:28.887030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:28.887460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:29.012403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:29.020652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7cc28b2-7422-47b8-a6e7-7f7aaeb6873a tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145412 May 16 17:13:29.021220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1103/1897] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:28 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:29.780748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:29.781580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:29.787927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:29.788384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:29.789150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:29.789589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:29.818533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a47effcf-2ab8-4c3c-8e41-b27d4cbed162 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 May 16 17:13:29.819090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 795/1898] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:29.834669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:29.835291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:29.841816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:29.842274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:29.843059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:29.843497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:29.904113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:29.911964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-81898cab-cabe-4a3d-84fc-392eb8b2dc0f tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081249 May 16 17:13:29.912534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1104/1899] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:29 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:30.037560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:30.038119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:30.043944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:30.044389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:30.045148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:30.045580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:30.168466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:30.176612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a8fce7a5-d85f-4c60-81f0-1aaea69fe862 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.143005 May 16 17:13:30.177183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 796/1900] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:30 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:30.830779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:30.831694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:30.837505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:30.838211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:30.838977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:30.839405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:30.867637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5419e9f3-c074-488d-919a-2d48713f5011 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 May 16 17:13:30.868172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1105/1901] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:30.928887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:30.929496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:30.936039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:30.936489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:30.937262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:30.937757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:30.998560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:31.005708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8a28b7f3-e893-47fd-b3e4-60f325a7e431 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080610 May 16 17:13:31.006292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 797/1902] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:30 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:31.193421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:31.193998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:31.199870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:31.200300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:31.201052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:31.201481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:31.333032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:31.341038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-198956e0-b511-4aeb-9b59-024a8705dc4e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.151556 May 16 17:13:31.341595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1106/1903] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:31 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:31.879048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:31.879877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:31.885683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:31.886225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:31.886976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:31.887406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:31.915391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eccdb2d7-2d05-4557-937e-202ae525794f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040420 May 16 17:13:31.915932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 798/1904] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:32.022554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:32.023170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:32.029456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:32.029939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:32.030701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:32.031871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:32.090470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:32.098263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8d115631-84d0-44c9-ae79-d6b4a95e8ab5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079529 May 16 17:13:32.098842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1107/1905] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:32 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:32.358580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:32.359196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:32.365468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:32.365963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:32.366725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:32.367163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:32.494056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:32.502342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-405d268c-e4ac-4a9d-96e3-12e60b75ee0b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.147639 May 16 17:13:32.502912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 799/1906] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:32 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:32.926824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:32.927745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:32.933612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:32.934098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:32.934868 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:32.935312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:32.963592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ddc9886a-6f2c-4b2c-ba50-5dad9617cd66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040520 May 16 17:13:32.964140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1108/1907] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:33.115702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:33.116670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:33.122583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:33.123038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:33.123808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:33.124247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:33.183290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:33.191436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-033ecc93-d4ca-4275-b2ce-a5ba3395ba78 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079659 May 16 17:13:33.192010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 800/1908] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:33 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:33.519717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:33.520256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:33.526495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:33.526935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:33.527687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:33.528113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:33.662794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:33.670483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9427f8e2-e50c-49b7-a6b0-95255e57f50b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.155129 May 16 17:13:33.671048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1109/1909] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:33 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:33.977981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:33.979211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:33.988910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:33.989411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:33.991971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:33.992414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:34.022064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7391d12a-0b38-4b11-9ee0-8adbf0b86c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050714 May 16 17:13:34.022631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 801/1910] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:34.207832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:34.208448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:34.214665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:34.215120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:34.215917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:34.216353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:34.278061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:34.285335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cb1704bc-f6f3-4ac8-819a-822b57cdb824 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081931 May 16 17:13:34.285929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1110/1911] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:34 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:34.687262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:34.688383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:34.694253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:34.694707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:34.695474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:34.695910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:34.820284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:34.828634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-279988ce-d3db-4d63-9368-48fb3f06564d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.144667 May 16 17:13:34.829217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 802/1912] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:34 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:35.033518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:35.034393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:35.040571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:35.041013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:35.041797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:35.042231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:35.071237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c473f40a-bc53-4afb-8292-2c32b60ec6f8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 May 16 17:13:35.071792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1111/1913] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:35 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:35.302523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:35.303064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:35.309586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:35.310119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:35.310896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:35.311333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:35.376588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:35.383970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e428b002-8718-4b6f-bf62-fb332cb5c36c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.085375 May 16 17:13:35.384538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 803/1914] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:35 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:35.940022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:35.940639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:35.946477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:35.946927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:35.947689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:35.948124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:36.074264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:36.082495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ecc1a27f-bb16-4461-adb6-0ce3edae472c tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.241165 May 16 17:13:36.083059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1112/1915] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:35 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:36.083209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:36.084264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:36.090620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:36.091084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:36.091863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:36.092305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:36.121535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c17bbd67-ba68-452c-add5-a22894d4fb3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042209 May 16 17:13:36.122148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 804/1916] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:36.400776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:36.401418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:36.407404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:36.407856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:36.408613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:36.409046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:36.469852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:36.476945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0de0c786-9c14-47f9-b2d6-ba5ccaf1d1cb tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.080058 May 16 17:13:36.477511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1113/1917] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:36 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:37.099709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:37.100314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:37.106591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:37.107043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:37.107793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:37.108222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:37.133519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:37.134566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:37.140923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:37.141378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:37.142174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:37.142614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:37.171220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a0b920c2-a9ba-4fc7-a7db-4e90e5171775 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 May 16 17:13:37.172635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1114/1918] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:37.232769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:37.241123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-20613fde-2072-418b-9a8a-52668c919d8d tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.145266 May 16 17:13:37.241687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 805/1919] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:37 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:37.493608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:37.494264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:37.500855 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:37.501317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:37.502119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:37.502560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:37.561097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:37.569087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e2d3c15c-fd95-486b-bdad-bf31a6025488 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079308 May 16 17:13:37.569667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1115/1920] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:37 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:38.183584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:38.184504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:38.190911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:38.191357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:38.192108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:38.192543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:38.221954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0f723ef8-8e40-4b5b-a220-b4d025ab7a79 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 May 16 17:13:38.222502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 806/1921] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:38.259255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:38.259875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:38.266293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:38.266744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:38.267514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:38.267961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:38.585951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:38.586575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:38.592588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:38.593035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:38.594389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:38.594828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:38.646247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:38.654074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:38.654345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b3640381-331e-4b9e-acff-4096e6076b55 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.398979 May 16 17:13:38.654928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1116/1922] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:38 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:38.661967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cc7e2205-6000-4f72-8a19-2096da601f1a tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079903 May 16 17:13:38.662529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 807/1923] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:38 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:39.233368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:39.234369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:39.240226 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.240671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.241420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.241881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.269658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-73a709b8-2bbf-4571-bf00-547d55933bd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040330 May 16 17:13:39.270327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1117/1924] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:39.599459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:39.599961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:39.606232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.606685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.607458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.607899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.632812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:13:39.672612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:39.673337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 384369a3-d514-4873-94eb-c7f9ffc45283] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:39.681033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.681493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.682918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.683362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.715519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d8236115-6c3f-4c65-823f-f9d88016ff21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 204 len: 0 microversion: 2.20 time: 0.119645 May 16 17:13:39.716106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 808/1925] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 16 17:13:39 2022] DELETE /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:13:39.723321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:39.724071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:39.731350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.731951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.733333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.734185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.809039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:39.816875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bb126e2f-6bd4-426c-9b58-a3dde55b476c tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.099605 May 16 17:13:39.817449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 809/1926] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:39 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:39.821954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:39.822564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:39.826652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:39.828955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.829406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.830204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:39.830641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:39.835367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-753cb38d-ddf6-4225-ab57-454f59cc9ca5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283" status: 200 len: 1736 microversion: 2.1 time: 0.167323 May 16 17:13:39.836038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1118/1927] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:39 2022] GET /compute/v2.1/servers/384369a3-d514-4873-94eb-c7f9ffc45283 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:39.852078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac11e939-6f48-487b-9bc4-2fdd9eb7befe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '.version_select at 0x7feacd89e160>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:39.870974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ac11e939-6f48-487b-9bc4-2fdd9eb7befe tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767529417" status: 202 len: 0 microversion: 2.1 time: 0.022554 May 16 17:13:39.871554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1119/1928] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 16 17:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767529417 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:13:39.964253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:39.973266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:39.975069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:39.976274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1ced2ac1-2425-4308-b9c3-faf4ca9a06ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157875 May 16 17:13:39.976837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 810/1929] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:40.282690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:40.283758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:40.290537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:40.291073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:40.291900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:40.292409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:40.321524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4e0ccc5e-9a6b-4619-b6f9-04a21c26b29a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 May 16 17:13:40.322161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1120/1930] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:40.821202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-2ae28ed9-5f4d-46fb-9891-56d79f3881b7 req-ca27f3b9-61b8-46fa-8d95-c21c9768d366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384369a3-d514-4873-94eb-c7f9ffc45283", "tag": "72814607-d40d-405f-923f-0e3b33277529"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:13:40.829144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-2ae28ed9-5f4d-46fb-9891-56d79f3881b7 req-ca27f3b9-61b8-46fa-8d95-c21c9768d366 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:40.829663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-2ae28ed9-5f4d-46fb-9891-56d79f3881b7 req-ca27f3b9-61b8-46fa-8d95-c21c9768d366 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:40.833107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:40.833763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:40.839972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:40.840432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:40.841207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:40.841650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:40.841958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-2ae28ed9-5f4d-46fb-9891-56d79f3881b7 req-ca27f3b9-61b8-46fa-8d95-c21c9768d366 service nova] Creating event network-changed:72814607-d40d-405f-923f-0e3b33277529 for instance 384369a3-d514-4873-94eb-c7f9ffc45283 on hv-cinder-83998 May 16 17:13:40.847821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-2ae28ed9-5f4d-46fb-9891-56d79f3881b7 req-ca27f3b9-61b8-46fa-8d95-c21c9768d366 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086938 May 16 17:13:40.847821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 811/1931] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:40.907984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:40.916130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f0ae3414-67e2-44e0-8446-31e0d42f9747 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.086547 May 16 17:13:40.916959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1121/1932] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:40 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:13:40.995433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:40.996048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:41.003052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:41.003503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:41.004283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:41.004730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:41.223970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:41.232600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:41.234748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:41.236020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2d91582b-274f-4657-b9c6-3a5a43b9e2b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.244889 May 16 17:13:41.236752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 812/1933] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:41.332975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:41.333967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:41.340588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:41.341258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:41.342063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:41.342503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:41.374497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7224202-ae68-4406-ab6f-25f58dd4ff12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 May 16 17:13:41.378554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1122/1934] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:41 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:41.933315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:41.933965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:41.940266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:41.940717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:41.941481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:41.941951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:42.003901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:42.011140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6f164384-63e4-4c6a-bdbc-5e4c375c444d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.081710 May 16 17:13:42.011705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 813/1935] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:41 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:42.254604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:42.255147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:42.260924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:42.261373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:42.262165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:42.262601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:42.385228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:42.386249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:42.388517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:42.392670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:42.393215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:42.394014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:42.394449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:42.397172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:42.398681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:42.399837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9dee06bc-56e2-4bad-803c-b1319f432db1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149217 May 16 17:13:42.400395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1123/1936] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:42.424443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aa9f2cca-26e1-4ce4-935a-6f312543efa1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043250 May 16 17:13:42.425014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 814/1937] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:42.454100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:13:42.454260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:13:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:13:43.028136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:43.028782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:43.035351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:43.035797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:43.036562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:43.037002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:43.099219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:43.106466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f306adec-1c0b-40a2-9059-a2e8d6a644a1 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.082249 May 16 17:13:43.107028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1124/1938] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:43 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:43.419490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:43.420108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:43.426541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:43.426994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:43.427762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:43.428197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:43.436016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:43.437070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:43.443843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:43.444303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:43.445133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:43.445579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:43.475202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0d611b08-9876-487d-8c4b-2c6cb1674905 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 May 16 17:13:43.475850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1125/1939] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:43.555936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:43.564669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:43.566197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:43.567363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7a824897-3e1a-4f50-b0da-21a848ef70b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151779 May 16 17:13:43.567924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 815/1940] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:44.122564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:44.123194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:44.129605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:44.130084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:44.130842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:44.131276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:44.189804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:44.196999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cc2fb3d3-4eec-43e7-a255-1d8dc27b54c5 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.078338 May 16 17:13:44.197561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1126/1941] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:44 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:44.487190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:44.488100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:44.494480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:44.494929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:44.495685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:44.496116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:44.523873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-aba20335-c973-437f-8d18-1350dd36fb25 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040696 May 16 17:13:44.524428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 816/1942] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:44.586237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:44.586852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:44.592923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:44.593502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:44.594788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:44.595233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:44.716270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:44.725157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:44.726677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:44.727830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-76d5d6e5-b502-4f8e-8748-fb7348c46355 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.145624 May 16 17:13:44.728387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1127/1943] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:45.214798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:45.215398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:45.221709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:45.222188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:45.222951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:45.223384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:45.282394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:45.289698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a6309d13-fcac-4973-8f7f-48d85d1b4557 tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079171 May 16 17:13:45.290294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 817/1944] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:45 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:45.534741 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:45.535664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:45.541521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:45.542001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:45.542767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:45.543202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:45.572704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e0a9583f-cf82-4b21-85e1-16dfd3ee78e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 May 16 17:13:45.573251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1128/1945] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:45.745709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:45.746285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:45.752128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:45.752579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:45.753372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:45.753838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:45.876202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:45.884387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:45.885914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:45.887079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-295a3bc2-1734-470a-93e1-985b8d3113a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.145370 May 16 17:13:45.887639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 818/1946] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:46.307211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:46.307804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:46.315007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:46.315454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:46.316211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:46.316645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:46.375986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:46.383278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0a8ef448-18b4-43dd-9ec4-cc38c0bef86d tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.079902 May 16 17:13:46.383842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1129/1947] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:46 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:46.584196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:46.585112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:46.591717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:46.592169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:46.592930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:46.593911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:46.621985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a0d9b712-c65b-4f75-8854-1b90c61f396a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 May 16 17:13:46.622526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 819/1948] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:46.905419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:46.906607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:46.912505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:46.912953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:46.913712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:46.914168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:47.041449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:47.050125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:47.051608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:47.052751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-429e2ef9-44d4-4d43-a7b5-d51664411f69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151350 May 16 17:13:47.053305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1130/1949] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:47.400467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:47.401122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] [instance: d5c2033c-4fee-4884-a6f7-de043836ebad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:47.407529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:47.407988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:47.408764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:47.409209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:47.471789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0f8b3570fb544c7be48b4bc3401e780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fbe5576de844559b26175408f40f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:47.479677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7deb1116-37d0-414f-9fd4-e8b622442eab tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad" status: 200 len: 1211 microversion: 2.1 time: 0.083218 May 16 17:13:47.480244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 820/1950] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:13:47 2022] GET /compute/v2.1/servers/d5c2033c-4fee-4884-a6f7-de043836ebad => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:13:47.632943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:47.633920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:47.640930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:47.641251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-945c928f-cfeb-4163-baa3-b65cec45942b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] Calling method '.version_select at 0x7feace2cb5e0>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:47.641389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:47.642230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:47.642589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:47.663208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-945c928f-cfeb-4163-baa3-b65cec45942b tempest-TestShelveInstance-1434333965 tempest-TestShelveInstance-1434333965-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327983792" status: 202 len: 0 microversion: 2.1 time: 0.026900 May 16 17:13:47.668368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 821/1951] 10.222.0.70 () {58 vars in 1250 bytes} [Mon May 16 17:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327983792 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:13:47.687760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-538bfb8e-4516-441f-b5de-759222386957 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059014 May 16 17:13:47.688311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1131/1952] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:48.071470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:48.072030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:48.078053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:48.078505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:48.080751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:48.082812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:48.209892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:48.218960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:48.220505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:48.221677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b0ecbdd4-ade9-4b41-bf3d-2c3f7a3ec2dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154243 May 16 17:13:48.222264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 822/1953] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:48.699076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:48.700148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:48.707286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:48.707812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:48.708663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:48.709653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:48.741816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-96c75abb-c473-4f18-9cb2-5ee8c5bcb1f9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 May 16 17:13:48.742671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1132/1954] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:49.240252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:49.241020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:49.247183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:49.248000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:49.248871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:49.249462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:49.384659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:49.393866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:49.395698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:49.397091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-de220ba6-7508-4250-9f07-5f1a39a42f11 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160846 May 16 17:13:49.408074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 823/1955] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:13:49.754776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:49.755709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:49.767277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:49.767805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:49.768658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:49.769165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:49.798700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da721cdf-cdb1-4f2a-9408-04754d801de5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 May 16 17:13:49.799275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1133/1956] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:50.421418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:50.422818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:50.436829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:50.437661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:50.438553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:50.439204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:50.596285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:50.606711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:50.608211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:50.609430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-358ad280-a0b0-4f0f-bfa1-5f0d13dd6218 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.197912 May 16 17:13:50.620539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 824/1957] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:50.809840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:50.810780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:50.817603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:50.817843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:50.818602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:50.819258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:50.855991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d7a480a2-3b54-4fae-89fc-2cb26d3c6a0f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050091 May 16 17:13:50.860539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1134/1958] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:51.628171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:51.628770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:51.635221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:51.635670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:51.636437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:51.636877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:51.867904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:51.868931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:51.875485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:51.875936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:51.876703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:51.877135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:51.906765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7add759b-9cd0-452a-b795-98572e15beae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 May 16 17:13:51.907335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1135/1959] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:13:51.936834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:51.945059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:51.946657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:51.947891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-70ced0dc-1aa1-4a47-9b38-b6c7a586f933 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.323656 May 16 17:13:51.948526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 825/1960] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:52.917586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:52.918527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:52.925208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:52.925652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:52.926435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:52.926865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:52.956423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0db3ecd8-2bb1-4245-b52b-76cfa3da8d55 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 May 16 17:13:52.956901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1136/1961] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:52.966944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:52.967550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:52.973829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:52.974281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:52.975045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:52.975473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:53.164970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:53.174599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:53.176207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:53.177463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-799a630c-9b6d-4d68-b2e2-7f199cc11373 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.214620 May 16 17:13:53.178352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 826/1962] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:13:53.971055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:53.971992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:53.984742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:53.985201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:53.986043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:53.986483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:54.038803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea99774c-058e-40b6-b748-99963d665d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075250 May 16 17:13:54.044111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1137/1963] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:54.195567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:54.196185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:54.202904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:54.203366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:54.204148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:54.204586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:54.334987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:54.345089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:54.346051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:54.347948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a4baed3a-44ac-4e3b-b62d-75a0c0b0aac4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156239 May 16 17:13:54.349027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 827/1964] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:13:55.051370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:55.052368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:55.058772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:55.059293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:55.060088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:55.060507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:55.092564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3381a19a-f2f8-44aa-97a8-c6cf0c33cc11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 May 16 17:13:55.096225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1138/1965] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:55.368336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:55.369005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:55.375328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:55.375773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:55.376537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:55.376967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:55.533138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:55.541368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:55.542909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:55.544101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b4cbe22e-1cbd-4b45-9556-482b5b68bd4e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.179815 May 16 17:13:55.544669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 828/1966] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:56.104067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:56.104991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:56.111354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:56.111797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:56.112554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:56.112989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:56.142724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-95d3d05c-5ed8-48ed-82af-f42ee1e2116c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 May 16 17:13:56.143279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1139/1967] 10.222.0.70 () {58 vars in 1301 bytes} [Mon May 16 17:13:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:13:56.563170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:56.563783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:56.570073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:56.570519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:56.571278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:56.571708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:56.697626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:56.706423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:56.707899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:56.709048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-268c01ba-ac53-40e0-83a0-868243a7a874 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149905 May 16 17:13:56.709608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 829/1968] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:57.154422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:13:57.155367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:57.161619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:57.162101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:57.162856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:57.163291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:57.259806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8a03616b-ae6f-4a67-9811-0a63e4e46a8c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/action" status: 200 len: 76177 microversion: 2.1 time: 0.109158 May 16 17:13:57.260445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1140/1969] 10.222.0.70 () {60 vars in 1277 bytes} [Mon May 16 17:13:57 2022] POST /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d/action => generated 76177 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:13:57.728303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:57.728839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:57.735217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:57.735670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:57.736428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:57.736859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:57.858980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:57.866959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:57.868443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:57.869598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-00ff16ab-ee70-46d5-b6d5-dc65d5ae4ded tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.145237 May 16 17:13:57.870176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 830/1970] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:13:58.888967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:13:58.889658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:13:58.896505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:58.896960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:58.897721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:13:58.898184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:13:59.026275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:59.034948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:59.036439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:13:59.037595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-54947114-74bb-46ab-b8ed-a8ed2012fd40 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152909 May 16 17:13:59.038198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1141/1971] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:13:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:14:00.056376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:00.056996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:00.063503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:00.063959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:00.064734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:00.065175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:00.191327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:00.199467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:00.200972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:00.202179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fd1470c1-980c-42fb-afbe-50aba829e8e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149696 May 16 17:14:00.203261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 831/1972] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:01.221136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:01.221674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:01.227928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:01.228378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:01.229130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:01.229562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:01.352852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:01.360935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:01.362470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:01.363642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-697ad4bc-ddf5-4448-99fb-a68a1eda836e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147172 May 16 17:14:01.364208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1142/1973] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:02.384249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:02.384857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:02.390946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:02.391393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:02.392149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:02.392580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:02.516574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:02.524626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:02.526142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:02.527300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6dbd1e26-9374-4164-88fb-2759d94062bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148304 May 16 17:14:02.527855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 832/1974] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:03.546226 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:03.547065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:03.553451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:03.553942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:03.554706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:03.555140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:03.690954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:03.699673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:03.701189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:03.702371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0d97302f-6dd2-4f54-b157-6191607884db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160397 May 16 17:14:03.703531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1143/1975] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:04.722059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:04.722626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:04.728821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:04.729263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:04.730050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:04.730484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:04.870580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:04.878684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:04.880162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:04.881311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0172710-2dbd-4c82-979a-3f0c47d45e84 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.163903 May 16 17:14:04.881913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 833/1976] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:05.900360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:05.900977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:05.907846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:05.908292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:05.909052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:05.909490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:06.032173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:06.040308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:06.041823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:06.042985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-dd637eff-bb07-49da-b7f3-22b0099b977b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146527 May 16 17:14:06.043545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1144/1977] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:07.062391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:07.062991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:07.069280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:07.069754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:07.070534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:07.070969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:07.195178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:07.203277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:07.204758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:07.205948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a804bb72-4835-4c32-856e-eae9e5f1e609 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148054 May 16 17:14:07.206506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 834/1978] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:08.224907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:08.225512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:08.231825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:08.232276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:08.233032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:08.234127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:08.356573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:08.365125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:08.366661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:08.367817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c358de80-09db-445b-8262-6bba007bbf12 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146828 May 16 17:14:08.368379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1145/1979] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:09.385094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:09.385711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:09.392593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:09.393041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:09.393831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:09.394272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:09.519470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:09.527655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:09.529159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:09.530970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6b95d201-f05b-4527-ae05-3a18aec61de5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149248 May 16 17:14:09.531533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 835/1980] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:10.550135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:10.550753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:10.557179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:10.557669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:10.558920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:10.559360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:10.687259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:10.695433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:10.696929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:10.698109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea019f9e-a8f7-4415-9efc-2bbc41270b61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152981 May 16 17:14:10.698672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1146/1981] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:11.716519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:11.717072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:11.723398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:11.723851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:11.724615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:11.725050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:11.851491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:11.860245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:11.861791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:11.862976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fb97c763-9859-4b9d-8a86-ac3e02ea6a58 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150713 May 16 17:14:11.863550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 836/1982] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:12.881836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:12.882533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:12.888894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:12.889345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:12.890227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:12.890662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:13.016765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:13.024884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:13.026412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:13.027573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-af54ac80-5718-423e-8da8-ec41c4fab6c0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150103 May 16 17:14:13.028129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1147/1983] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:14.046498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:14.047115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:14.053408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:14.053889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:14.054654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:14.055091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:14.177830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:14.185977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:14.188103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:14.189269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae61e912-eff2-40c2-9207-9d637c600ff7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146726 May 16 17:14:14.189846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 837/1984] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:15.207492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:15.208124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:15.214786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:15.215229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:15.215976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:15.216407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:15.344194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:15.352221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:15.353701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:15.354869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-59a63a77-6670-464d-802b-37d2ec57c818 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151324 May 16 17:14:15.355419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1148/1985] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:16.372737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:16.373349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:16.379896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:16.380347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:16.381111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:16.381546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:16.510039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:16.518770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:16.520263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:16.521425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e0f11dae-542d-4246-b9b6-21da463a831e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152604 May 16 17:14:16.522019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 838/1986] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:17.539635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:17.540249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:17.547082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:17.547529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:17.548287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:17.548722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:17.672820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:17.680934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:17.682464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:17.683622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-45106be7-a886-4f22-8e98-8f3df4a3b9de tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147896 May 16 17:14:17.684190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1149/1987] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:18.702477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:18.703040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:18.709315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:18.709790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:18.710566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:18.711004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:18.836645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:18.845050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:18.846586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:18.847745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c646e80b-8bed-4070-a324-78b769da0dd8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149888 May 16 17:14:18.848316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 839/1988] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:19.865838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:19.866470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:19.872767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:19.873219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:19.874613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:19.875059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:20.001846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:20.009993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:20.011499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:20.012664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-38375b4d-6d14-447f-97b0-6ccaa2e530af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150746 May 16 17:14:20.013228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1150/1989] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:21.030287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:21.030916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:21.037296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:21.037785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:21.038566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:21.039001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:21.165359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:21.173502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:21.175078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:21.176242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4131470e-02dd-4580-beb2-cd3bc85efeb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149970 May 16 17:14:21.176811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 840/1990] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:22.195112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:22.195772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:22.202052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:22.202502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:22.203264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:22.203708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:22.327283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:22.335947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:22.337724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:22.339154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8780f8c9-87a1-4ae7-8a61-cd47617c2350 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148024 May 16 17:14:22.339721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1151/1991] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:23.357709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:23.358367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:23.364645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:23.365103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:23.365889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:23.366327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:23.492469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:23.501314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:23.502843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:23.504009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8c472270-4612-4c18-b7b8-a8fe6b0d304c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150237 May 16 17:14:23.504578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 841/1992] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:24.522640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:24.523257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:24.529567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:24.530468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:24.531366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:24.532167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:24.661854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:24.670298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:24.671782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:24.672927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0f3219e4-355d-43ff-8798-91325693f81f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154273 May 16 17:14:24.673485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1152/1993] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:25.692031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:25.692606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:25.698860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:25.699314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:25.700077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:25.700511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:25.823819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:25.832821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:25.834682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:25.835838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-beb65acd-0fd3-4bc1-ad3f-be3b622a24f8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147843 May 16 17:14:25.836389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 842/1994] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:26.854036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:26.854725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:26.861488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:26.862071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:26.862830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:26.863263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:26.989785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:26.997858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:26.999336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:27.000516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ceacea1e-6917-4e8c-8498-43eb3a0dafb8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150429 May 16 17:14:27.001085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1153/1995] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:28.018420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:28.019029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:28.025508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:28.025999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:28.026799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:28.027237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:28.156854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:28.164968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:28.166512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:28.167681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9b9f1a8e-f45a-49c5-9d49-79367a7a62d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153397 May 16 17:14:28.168242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 843/1996] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:29.186541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:29.187081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:29.193323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:29.193791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:29.194547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:29.194984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:29.321648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:29.330270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:29.331745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:29.332892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c283ca0a-cd95-40bf-8589-f7dcec80790a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150872 May 16 17:14:29.333453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1154/1997] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:30.350836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:30.351439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:30.357835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:30.358289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:30.359056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:30.359493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:30.489705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:30.497889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:30.499446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:30.500601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-36da3c48-3b24-48c7-bfcc-2513ab4c1581 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153812 May 16 17:14:30.501166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 844/1998] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:31.519212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:31.519839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:31.526200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:31.526655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:31.527421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:31.527861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:31.659063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:31.667215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:31.668637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:31.669812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2b59a819-5da9-4f9b-9fcd-5250f31a38d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154495 May 16 17:14:31.670413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1155/1999] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:32.688244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:32.688793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:32.695072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:32.695520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:32.696285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:32.696722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:32.823223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:32.831920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:32.833402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:32.834617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7af5057b-c221-46d8-8c73-9a0fb7499410 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150414 May 16 17:14:32.835176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 845/2000] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:33.853688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:33.854352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:33.861231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:33.861678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:33.862458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:33.862898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:33.986433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:33.994500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:33.995999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:33.997160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8e4b5df8-f851-40f6-9d32-d0ee9e4556fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147383 May 16 17:14:33.997722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1156/2001] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:35.016065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:35.016671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:35.022935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:35.023404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:35.024166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:35.024602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:35.150443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:35.158788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:35.160272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:35.161425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-705381ea-b38f-480b-9abb-2bf1b5fa9973 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149297 May 16 17:14:35.162019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 846/2002] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:36.179122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:36.179732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:36.186727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:36.187170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:36.187920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:36.188353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:36.313181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:36.321288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:36.322814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:36.323983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d9767c7f-3b5a-471a-99df-4abf03e7ceab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148866 May 16 17:14:36.324577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1157/2003] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:37.343211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:37.343744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:37.350045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:37.350496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:37.351256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:37.351690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:37.476504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:37.485086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:37.486616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:37.487777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7e329407-458d-4aa7-91cd-f367784bb8f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149146 May 16 17:14:37.488338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 847/2004] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:38.506917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:38.507523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:38.514289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:38.514850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:38.515609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:38.516300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:38.656261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:38.664665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:38.666118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:38.667284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f363fddc-33e0-41d8-9d0d-b17564cb3b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.164372 May 16 17:14:38.667849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1158/2005] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:14:39.685011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:39.686117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:39.692415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:39.692862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:39.693622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:39.694087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:39.819411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:39.828292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:39.829824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:39.830992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8b25a285-7f60-44f3-9493-a4cb58532375 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149966 May 16 17:14:39.831562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 848/2006] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:40.849178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:40.849812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:40.856091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:40.856537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:40.857298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:40.857759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:40.982388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:40.990545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:40.992050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:40.993213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f7929a5e-6bc3-41bf-9ac9-2b1177258822 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148006 May 16 17:14:40.993798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1159/2007] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:42.011759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:42.012399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:42.018758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:42.019205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:42.019970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:42.020407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:42.147112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:42.155235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:42.156731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:42.157930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0249143c-5feb-4836-92dd-24e24beefc4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150084 May 16 17:14:42.158497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 849/2008] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:43.176659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:43.177396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:43.183740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:43.184186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:43.184945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:43.185378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:43.314214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:43.322389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:43.323897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:43.325055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-14e85c87-cc72-4183-8b68-ac8b10048bcc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152306 May 16 17:14:43.325618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1160/2009] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:44.344373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:44.344968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:44.351229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:44.351700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:44.352458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:44.352890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:44.480078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:44.488763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:44.490282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:44.491563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7c78b979-837c-4cb3-a1e4-de343516f20d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151189 May 16 17:14:44.492131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 850/2010] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:45.510072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:45.510683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:45.516870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:45.517274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:45.518069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:45.518515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:45.646169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:45.654905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:45.656430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:45.657602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-050b686f-7942-4ed7-a375-0a5d8e945f1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151500 May 16 17:14:45.658215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1161/2011] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:46.676064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:46.676605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:46.682666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:46.683114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:46.683876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:46.684310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:46.807944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:46.816761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:46.818297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:46.819474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3ae39e29-9ca8-40da-8cc4-b7b646d73934 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147483 May 16 17:14:46.820033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 851/2012] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:47.838027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:47.838643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:47.845435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:47.845905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:47.846657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:47.847087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:47.972465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:47.980499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:47.982429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:47.983708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-22597a96-df7f-47cd-80df-4a1282124b00 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149835 May 16 17:14:47.984275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1162/2013] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:49.001992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:49.002592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:49.008960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:49.009422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:49.010223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:49.010665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:49.138169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:49.146760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:49.148253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:49.149419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1103acab-5e17-4839-8de6-144a834eb5ff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151393 May 16 17:14:49.150028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 852/2014] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:50.168300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:50.168906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:50.175805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:50.176253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:50.177006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:50.177439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:50.301486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:50.309528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:50.311053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:50.312198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b8be2344-911f-47b2-8456-b6055cc60174 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147755 May 16 17:14:50.312756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1163/2015] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:51.331379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:51.332611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:51.340759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:51.341262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:51.342625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:51.343055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:51.471720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:51.480107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:51.481616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:51.482840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e814aec8-9a10-447b-a23e-8e492183872c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155529 May 16 17:14:51.483403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 853/2016] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:52.501441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:52.502086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:52.508411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:52.508858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:52.509608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:52.510071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:52.640041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:52.651123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:52.652637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:52.653846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c77e5199-7d2b-4258-81d9-06a79d138aa6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156438 May 16 17:14:52.654417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1164/2017] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:53.673382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:53.673976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:53.680390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:53.680840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:53.681616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:53.682098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:53.813704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:53.821948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:53.823460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:53.824639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76e85a72-39cd-486d-9778-eaff7aed0ddc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155926 May 16 17:14:53.825213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 854/2018] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:54.842887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:54.843509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:54.849810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:54.850272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:54.851035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:54.851474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:54.982991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:54.991675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:54.993169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:54.994369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f83e9841-4170-4112-9b1e-5dfcc51a3577 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155399 May 16 17:14:54.994933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1165/2019] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:56.013196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:56.013872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:56.020783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:56.021236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:56.022044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:56.022488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:56.155553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:56.163914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:56.165424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:56.166618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ff370e5d-bb69-4c6d-b829-7db9ceb39a1c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157363 May 16 17:14:56.167190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 855/2020] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:57.184397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:57.185011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:57.191314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:57.191768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:57.192528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:57.192966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:57.317240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:57.325332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:57.326850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:57.328002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9b381fa7-e0e2-4aef-bef6-4491c656dd79 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147517 May 16 17:14:57.329088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1166/2021] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:58.347420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:58.348028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:58.354420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:58.354869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:58.355632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:58.356060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:58.482487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:58.491308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:58.492805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:58.494005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e740113d-57c1-4d88-83c6-56b41c48a9c9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150943 May 16 17:14:58.494575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 856/2022] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:14:59.512674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:14:59.513385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:14:59.520652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:59.521177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:59.521971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:14:59.522407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:14:59.650653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:59.660117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:59.661901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:14:59.663143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a5aad800-e0f6-4d4e-89be-850bbea8ca74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154734 May 16 17:14:59.663938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1167/2023] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:14:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:00.682238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:00.682890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:00.689946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:00.690402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:00.691166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:00.691599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:00.818443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:00.826532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:00.828027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:00.829786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7daf84c-0c6e-46fb-81cd-b5f737cc7797 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151626 May 16 17:15:00.830356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 857/2024] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:01.848788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:01.849401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:01.855636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:01.856080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:01.856830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:01.857337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:01.980408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:01.988492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:01.990014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:01.991167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-766851e6-ea5e-477c-b3ac-61f48d88c915 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146296 May 16 17:15:01.991718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1168/2025] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:03.008494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:03.009107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:03.015472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:03.016502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:03.017278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:03.017725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:03.149972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:03.158550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:03.160085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:03.161296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-80c3a6cf-0d53-4206-b515-38c4b43c318b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156780 May 16 17:15:03.162053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 858/2026] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:04.180671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:04.181271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:04.187584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:04.188029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:04.188785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:04.189216 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:04.314829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:04.322919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:04.324407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:04.325557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5699abda-451f-44ca-9c6d-5eab8e84308b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148880 May 16 17:15:04.326141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1169/2027] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:05.344482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:05.345099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:05.352030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:05.352427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:05.353207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:05.353676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:05.486481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:05.494916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:05.496411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:05.497574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3bb5b058-0599-4be0-8a0d-d4777b1f89db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157062 May 16 17:15:05.498182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 859/2028] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:06.517069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:06.517664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:06.524001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:06.524446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:06.525200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:06.525633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:06.657345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:06.665691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:06.667151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:06.668324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a2d3ac4c-7c7c-4635-8aa8-8a8bc1a89397 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155671 May 16 17:15:06.668894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1170/2029] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:07.686505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:07.687059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:07.694064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:07.694519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:07.695289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:07.695725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:08.076004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:08.084420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:08.085946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:08.087114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-61e170b2-4951-4788-93b5-aa04d59bf1a6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.404638 May 16 17:15:08.087951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 860/2030] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:09.105833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:09.106447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:09.112800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:09.113245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:09.114096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:09.114532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:09.241273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:09.249409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:09.251706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:09.252861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f63ae20d-5197-472c-9882-b8faf741ed16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151012 May 16 17:15:09.253426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1171/2031] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:10.271294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:10.271895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:10.278287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:10.278741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:10.279527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:10.279961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:10.409446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:10.418022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:10.419550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:10.420726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e8c3ffdc-46a3-4d6c-ad99-b5b58580d713 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153339 May 16 17:15:10.421308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 861/2032] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:11.441505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:11.442144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:11.448501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:11.448947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:11.449706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:11.450160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:11.579934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:11.588421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:11.589936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:11.591094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-569ee009-c10c-41b3-94c3-af1bf8bac4b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154309 May 16 17:15:11.591651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1172/2033] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:12.610023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:12.610630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:12.617042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:12.617489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:12.618293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:12.618725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:12.765115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:12.774180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:12.775673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:12.776830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e1b2e2e-d428-4ee5-a4c0-2d9ca8803e21 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.170810 May 16 17:15:12.777383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 862/2034] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:13.795444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:13.796016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:13.802455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:13.802922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:13.803705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:13.804148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:13.936075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:13.944661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:13.946195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:13.947374 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9605774b-2785-47bd-9728-d06ce1f896eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155993 May 16 17:15:13.947940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1173/2035] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:14.966547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:14.967158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:14.973563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:14.974050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:14.974814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:14.975256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:15.102487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:15.112589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:15.114415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:15.115601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7cf22fd3-a377-419b-829d-12071186f2b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153407 May 16 17:15:15.116173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 863/2036] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:16.135512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:16.136161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:16.142249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:16.142704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:16.143472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:16.143912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:16.297315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:16.306408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:16.307886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:16.309036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d86703d2-f6ed-45e4-855c-ed839b08935b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.177491 May 16 17:15:16.309598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1174/2037] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:17.327524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:17.328129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:17.335070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:17.335524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:17.336320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:17.336759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:17.468095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:17.476330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:17.477862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:17.479031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f4a7704-04c7-42d2-bd3f-37dfb3e37514 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155517 May 16 17:15:17.479594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 864/2038] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:18.497823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:18.498474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:18.504773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:18.505222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:18.506004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:18.506437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:18.631317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:18.641135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:18.643183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:18.645650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-991395e3-61cb-46d7-9632-a170664bb23c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151591 May 16 17:15:18.646512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1175/2039] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:19.664008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:19.664674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:19.671007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:19.671401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:19.672168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:19.672604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:19.796658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:19.805293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:19.806819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:19.808016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-13429483-4a1d-4c19-b2ee-dcbf2f612234 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148523 May 16 17:15:19.808580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 865/2040] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:20.827461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:20.828023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:20.834279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:20.834723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:20.835474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:20.835905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:20.963678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:20.972095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:20.974249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:20.975412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4db04f4c-562e-424f-a02c-94895f1673d4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151942 May 16 17:15:20.975978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1176/2041] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:21.994712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:21.995461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:22.003052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:22.003620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:22.004580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:22.005086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:22.144402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:22.154663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:22.156439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:22.157803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-580b118f-764f-451d-beb3-578674003671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.167875 May 16 17:15:22.158469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 866/2042] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:23.179077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:23.179682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:23.186078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:23.186531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:23.187285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:23.187720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:23.323818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:23.331896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:23.333380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:23.335067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fc795297-bc08-42ee-8290-8162fd0acb16 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160004 May 16 17:15:23.335621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1177/2043] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:24.354033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:24.354662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:24.361076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:24.361530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:24.362329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:24.362770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:24.504266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:24.512710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:24.514234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:24.515410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c6d7868f-f940-4b14-abe2-18e4fdfac18a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.165800 May 16 17:15:24.515972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 867/2044] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:25.534281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:25.534909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:25.542292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:25.542750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:25.543531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:25.543971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:25.679144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:25.687924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:25.689425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:25.690642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c6d620ae-bc98-43b3-9fac-9588b855a4cc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160517 May 16 17:15:25.691214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1178/2045] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:26.708817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:26.709545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:26.716792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:26.717245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:26.718055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:26.718491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:26.851728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:26.859990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:26.861487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:26.862679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1cce5b38-420f-443b-a9c4-72b9b596eb75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157947 May 16 17:15:26.863252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 868/2046] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:27.880569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:27.881199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:27.888407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:27.888852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:27.889608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:27.890067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:28.021355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:28.029698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:28.031205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:28.032370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-81cd2f91-36c5-4476-a899-912fb6ba68d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155790 May 16 17:15:28.032926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1179/2047] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:29.049899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:29.050516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:29.056956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:29.057405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:29.058262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:29.058696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:29.197930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:29.206066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:29.207566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:29.208730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d4c9193d-2676-4ecc-8834-ee14884053a3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.162794 May 16 17:15:29.209296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 869/2048] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:30.228548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:30.229147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:30.235410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:30.235849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:30.236600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:30.237026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:30.375795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:30.384834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:30.386334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:30.387514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-44e57176-7c75-4961-b3cd-0488793560e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.163555 May 16 17:15:30.388078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1180/2049] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:31.406794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:31.407442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:31.414544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:31.415376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:31.415761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:31.416207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:31.544221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:31.552478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:31.554017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:31.555195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7800dde5-0d4c-4a17-afb3-37af219820eb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152460 May 16 17:15:31.555756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 870/2050] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:32.573609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:32.574278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:32.580525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:32.580973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:32.581752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:32.582196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:32.711479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:32.720539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:32.722212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:32.723509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-690f24a2-3035-4129-ae6f-f448cd409af4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153814 May 16 17:15:32.724111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1181/2051] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:33.742011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:33.742584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:33.748812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:33.749262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:33.750054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:33.750500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:33.879641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:33.888504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:33.890041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:33.891495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d2242ad9-1216-451d-b6dc-38e5cf8dca07 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153409 May 16 17:15:33.892203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 871/2052] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:34.913655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:34.914283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:34.920599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:34.921045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:34.921823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:34.922262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:35.061994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:35.071935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:35.073460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:35.074684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8397a376-333a-4c00-9c1d-74109f1693f2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.165432 May 16 17:15:35.075259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1182/2053] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:36.097033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:36.097937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:36.107076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:36.107645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:36.108519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:36.108943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:36.242079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:36.250817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:36.252605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:36.253950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-14ec2f11-d3c3-43f0-8a5c-9d1eef984324 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.163092 May 16 17:15:36.254523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 872/2054] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:37.275408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:37.276200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:37.284138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:37.284668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:37.285677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:37.286317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:37.419739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:37.427918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:37.430215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:37.431378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-795344ee-a5a4-4c2c-8f15-64741b08812b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.161247 May 16 17:15:37.431941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1183/2055] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:38.451919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:38.452759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:38.461518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:38.462289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:38.463182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:38.463679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:38.598710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:38.607926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:38.609438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:38.610645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6525f5f1-7545-4667-8ce1-120775ea2fe4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.164050 May 16 17:15:38.611214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 873/2056] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:39.628970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:39.629557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:39.636664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:39.637244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:39.637928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:39.638360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:39.783566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:39.791960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:39.793450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:39.794650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-63fae817-eed4-40f9-a417-42e32a25a9f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.169550 May 16 17:15:39.795217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1184/2057] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:40.813653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:40.814305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:40.820636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:40.821090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:40.821898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:40.822342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:40.953532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:40.962309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:40.963819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:40.965001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3b8af5c3-bf72-4bbb-a1a0-3c649cbf42f6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155323 May 16 17:15:40.965576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 874/2058] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:41.984031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:41.984635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:41.991247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:41.991696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:41.992459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:41.992896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:42.119588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:42.128392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:42.129941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:42.131114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-616d2f54-c816-4849-9475-ea75d5172ba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151043 May 16 17:15:42.131679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1185/2059] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:43.149914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:43.150531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:43.156837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:43.157288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:43.158086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:43.158529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:43.298193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:43.306994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:43.308502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:43.309667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3ec04242-ef15-4076-abd1-b8708ede05ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.163698 May 16 17:15:43.310343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 875/2060] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:44.328243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:44.328858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:44.335237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:44.335692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:44.336462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:44.337170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:44.468999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:44.477792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:44.479284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:44.480468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b087125f-ca8c-430d-af1b-fee753a2062a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156179 May 16 17:15:44.481033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1186/2061] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:45.500203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:45.500807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:45.508641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:45.509218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:45.510360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:45.510951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:45.652472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:45.660856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:45.662325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:45.663684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1d7d59aa-279e-41fe-a4de-27059b9a4d14 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.167751 May 16 17:15:45.664261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 876/2062] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:46.682781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:46.683357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:46.690631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:46.691122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:46.691973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:46.692491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:46.821886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:46.830028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:46.831542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:46.832717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c92ced38-13e1-4df8-8361-0ac44ff623f4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154339 May 16 17:15:46.833509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1187/2063] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:47.852923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:47.853533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:47.860109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:47.860646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:47.861429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:47.861888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:47.990742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:47.999632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:48.001119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:48.002316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-21a93ad4-c060-4253-8ffe-d7db31bd08bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153798 May 16 17:15:48.002887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 877/2064] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:49.020535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:49.021142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:49.027519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:49.027957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:49.028721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:49.029157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:49.164598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:49.173037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:49.174569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:49.175737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c0c804e2-c1c2-4cee-8fa3-0a0d497a6cdb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.159131 May 16 17:15:49.176293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1188/2065] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:50.195048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:50.195656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:50.202073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:50.202526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:50.203302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:50.203738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:50.337613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:50.346137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:50.347638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:50.348800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55096c72-ac8b-4782-a694-97f32393601f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158175 May 16 17:15:50.349358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 878/2066] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:51.367256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:51.367860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:51.374338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:51.374783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:51.375553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:51.375985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:51.512108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:51.521050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:51.523208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:51.524383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c2d46427-8b9c-4548-a966-273d1764e3df tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.161232 May 16 17:15:51.524937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1189/2067] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:52.543118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:52.543733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:52.550171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:52.550617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:52.551387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:52.551818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:52.703500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:52.712701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:52.714232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:52.715401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-48f59d0f-b04e-4e28-82f4-6e0780caf5d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.176819 May 16 17:15:52.715962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 879/2068] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:53.735160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:53.735842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:53.742295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:53.742746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:53.743513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:53.743949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:53.872608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:53.882057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:53.883570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:53.884758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-666777b1-6323-4786-90f7-d7129cb87a2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153640 May 16 17:15:53.885329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1190/2069] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:54.903674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:54.904440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:54.915317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:54.915317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:54.915317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:54.915317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:55.051524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:55.060891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:55.062446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:55.063608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a2ee074a-3ad5-4107-a3ab-1dfd28013e96 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.163899 May 16 17:15:55.064262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 880/2070] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:56.082822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:56.083601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:56.091173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:56.091618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:56.092638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:56.093234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:56.226403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:56.234740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:56.236232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:56.237425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b7122b4c-0dfb-4e17-8eca-c721b2ad48d1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158770 May 16 17:15:56.238025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1191/2071] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:57.256416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:57.257027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:57.263428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:57.263886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:57.264671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:57.265109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:57.394327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:57.403232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:57.404718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:57.405959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8016a578-b19b-4186-a4dd-3a1b019698d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153446 May 16 17:15:57.406523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 881/2072] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:58.425960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:58.426753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:58.433673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:58.434147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:58.434921 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:58.435362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:58.567889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:58.576447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:58.578014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:58.579204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0966fa37-ee19-4e98-a0b7-d8477ec37dac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157223 May 16 17:15:58.579773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1192/2073] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:15:59.598199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:15:59.598809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:15:59.605781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:59.606232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:59.607012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:15:59.607443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:15:59.739298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:59.750562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:59.752041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:15:59.753201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b93051eb-3ede-4ce2-98b4-03fb9c7a2dce tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158989 May 16 17:15:59.753779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 882/2074] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:15:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:00.771636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:00.772309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:00.778850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:00.779275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:00.780034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:00.780463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:00.921217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:00.930250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:00.931769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:00.932947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-586e521f-dff0-4c13-b646-3dc1815f5897 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.165235 May 16 17:16:00.933540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1193/2075] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:01.952247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:01.952871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:01.960059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:01.960515 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:01.961292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:01.962013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:02.094477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:02.103350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:02.104935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:02.106164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-30f55478-6d55-447a-a64a-5d3525264efe tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157939 May 16 17:16:02.106735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 883/2076] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:03.124634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:03.125258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:03.131742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:03.132193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:03.132958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:03.133398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:03.262372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:03.270561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:03.272555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:03.273717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e1d3d74f-e6c1-4ce6-bca1-6713794bf553 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153099 May 16 17:16:03.274294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1194/2077] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:04.292325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:04.292945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:04.299548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:04.299992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:04.300794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:04.301226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:04.438831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:04.447124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:04.448674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:04.450044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2d731130-f258-4d9d-a8b2-b4ca7486e388 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.161482 May 16 17:16:04.450755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 884/2078] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:05.472727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:05.473331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:05.479852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:05.480299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:05.481074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:05.481506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:05.610749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:05.619631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:05.621134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:05.622342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9ff75155-0bfc-4704-86c3-74d5044242cb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153590 May 16 17:16:05.622902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1195/2079] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:06.640668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:06.641285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:06.648367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:06.648819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:06.649592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:06.650069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:06.784666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:06.792958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:06.794497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:06.795675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3bd7415c-8449-4a3b-9045-c469e7f4bb01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158987 May 16 17:16:06.796240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 885/2080] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:07.814630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:07.815216 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:07.821497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:07.821986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:07.822759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:07.823207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:07.953699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:07.963469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:07.964977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:07.966201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d6c8865-5152-4c8a-92a6-a79772e156f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155563 May 16 17:16:07.966774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1196/2081] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:08.984564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:08.985162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:08.992227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:08.992681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:08.993462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:08.993929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:09.120485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:09.129372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:09.131491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:09.132688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2b0e0397-f07d-413f-b187-2c8103ff6716 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152079 May 16 17:16:09.133254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 886/2082] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:10.150951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:10.151565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:10.158474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:10.158934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:10.159713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:10.160151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:10.288420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:10.296626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:10.298161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:10.299333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e5f60747-9928-41ac-b14a-c5ed56992730 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152364 May 16 17:16:10.299896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1197/2083] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:16:11.319465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:11.320053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:11.326597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:11.327050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:11.327817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:11.328249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:11.459323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:11.469956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:11.471566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:11.472752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-84e93d36-5729-447d-b671-71a3db17b5ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157951 May 16 17:16:11.473312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 887/2084] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:12.494223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:12.494833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:12.501252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:12.501727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:12.502561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:12.502996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:12.634383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:12.642709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:12.644191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:12.645387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4fb8b1ba-d967-46ba-be58-bb84cac42e24 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155118 May 16 17:16:12.646002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1198/2085] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:13.664580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:13.665135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:13.672142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:13.672587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:13.673380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:13.673835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:13.803071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:13.811424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:13.813047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:13.814230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-741412e1-9804-4411-843e-7d326ab5904e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153673 May 16 17:16:13.814793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 888/2086] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:14.832474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:14.833097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:14.839966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:14.840417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:14.841189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:14.841630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:14.967409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:14.975788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:14.977289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:14.978497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-88d3a8a9-5a2a-472f-8ac2-86c60b4e8518 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149984 May 16 17:16:14.979073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1199/2087] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:15.996748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:15.997361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:16.003396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:16.003848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:16.004613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:16.005046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:16.136009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:16.144596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:16.146106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:16.147845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a4f595ad-ca11-43bf-b1fc-c0ee5a983def tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154984 May 16 17:16:16.148409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 889/2088] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:17.166679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:17.167312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:17.173589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:17.174066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:17.174832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:17.175271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:17.304225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:17.312560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:17.314065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:17.315231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b4014bfc-d3e3-437b-b4a6-d1a90a8dcaee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152456 May 16 17:16:17.315801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1200/2089] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:18.334162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:18.334768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:18.341298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:18.341761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:18.342540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:18.342970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:18.504558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:18.513873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:18.515370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:18.516543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b742d332-ac5c-4fd4-bbcf-65e787406e71 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.186791 May 16 17:16:18.517113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 890/2090] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:19.536468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:19.537768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:19.544037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:19.544494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:19.545258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:19.545693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:19.676510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:19.685083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:19.686919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:19.688114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c360c36a-8fca-48b1-9336-bab613b73615 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155667 May 16 17:16:19.688681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1201/2091] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:20.707151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:20.707705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:20.715048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:20.715498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:20.716271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:20.716705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:20.842528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:20.851413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:20.852921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:20.854165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f69cf080-fe99-4289-8813-a67f1f80654b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151326 May 16 17:16:20.854739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 891/2092] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:21.872413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:21.873068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:21.879465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:21.879906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:21.880759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:21.881195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:22.007489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:22.015814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:22.017295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:22.018485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-214783f3-9371-4ed6-8b52-0ad012c91b5e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149968 May 16 17:16:22.019053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1202/2093] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:23.037755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:23.038440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:23.044854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:23.045305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:23.046147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:23.046586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:23.178008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:23.186516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:23.188045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:23.189213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f8bc17ff-4eab-481d-b4cb-e453ebb67a67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155879 May 16 17:16:23.189815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 892/2094] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:24.207773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:24.208417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:24.215167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:24.215901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:24.216670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:24.217105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:24.345483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:24.354197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:24.355676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:24.356837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6ef5680a-73b5-4ddb-9e3e-2eeca3a45075 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152989 May 16 17:16:24.357397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1203/2095] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:25.375780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:25.376410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:25.382821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:25.383326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:25.384074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:25.384510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:25.511885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:25.520174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:25.522215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:25.523387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fba740d-ef6b-4c95-b675-7d486d0750bf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151554 May 16 17:16:25.523952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 893/2096] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:26.543745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:26.544343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:26.550625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:26.551073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:26.551832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:26.552801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:26.683629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:26.692105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:26.693632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:26.694820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a1dd10b4-fbbf-4404-a9a1-91f9170f54cd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155326 May 16 17:16:26.695380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1204/2097] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:27.713385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:27.713999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:27.720726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:27.721177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:27.721978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:27.722414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:27.848904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:27.857992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:27.859753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:27.860978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cd49dc54-f516-4113-919e-08cca2a0544c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152405 May 16 17:16:27.861547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 894/2098] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:28.879133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:28.879727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:28.888229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:28.889070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:28.889875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:28.890310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:29.014170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:29.022982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:29.024487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:29.025699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d3a221ed-a27a-4a3f-ac28-c4c75ef38c89 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150429 May 16 17:16:29.026301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1205/2099] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:30.044062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:30.044750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:30.051116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:30.051568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:30.052847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:30.053280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:30.188201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:30.197925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:30.199431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:30.200613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c74118c1-dd4d-4c97-92e8-783c1211aa85 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160549 May 16 17:16:30.201182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 895/2100] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:31.219099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:31.219686 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:31.226068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:31.226521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:31.227300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:31.227737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:31.356219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:31.364289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:31.365838 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:31.367003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33961626-eaa9-4eb0-8bd1-8447244d7686 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152025 May 16 17:16:31.367573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1206/2101] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:16:32.385122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:32.385764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:32.392214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:32.392661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:32.393447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:32.393909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:32.684876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:32.693621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:32.695156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:32.696347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d722e299-e29d-450b-9001-c8b538a48c5b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.315129 May 16 17:16:32.696896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 896/2102] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:33.714916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:33.715472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:33.721787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:33.722239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:33.723000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:33.723460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:33.853358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:33.861894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:33.863385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:33.865061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea51de0d-7249-41c1-8e21-b9fcebe97f15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153887 May 16 17:16:33.865634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1207/2103] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:34.883531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:34.884134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:34.890717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:34.891166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:34.891942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:34.892377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:35.021423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:35.029986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:35.031459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:35.032618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b430df69-8412-4cb7-b228-56eeebbeef9c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153042 May 16 17:16:35.033171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 897/2104] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:36.052615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:36.053228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:36.059609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:36.060107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:36.060861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:36.061301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:36.191761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:36.200118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:36.201642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:36.202837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b6961b53-03ac-4be0-b43d-a390ecad16af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154309 May 16 17:16:36.203406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1208/2105] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:37.222543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:37.223150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:37.230013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:37.230459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:37.231229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:37.231664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:37.360250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:37.369079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:37.370606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:37.371775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f7c4fe0-30e8-4bf0-b2d7-d1f9f4359427 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153733 May 16 17:16:37.372325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 898/2106] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:38.390856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:38.391635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:38.397918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:38.398378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:38.399141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:38.399575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:38.531652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:38.535755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:16:38.536887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:16:38.541030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:38.542699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:38.543929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d38e0e91-5f93-4aa7-a6e1-2abe2695dd86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157564 May 16 17:16:38.544485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1209/2107] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:39.562992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:39.563638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:39.570608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:39.571061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:39.571845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:39.572285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:39.701876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:39.710905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:39.712677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:39.713879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-482578bf-eddd-4192-b3bf-104debe46ddf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154818 May 16 17:16:39.714433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 899/2108] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:40.732359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:40.732969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:40.739481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:40.739963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:40.741397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:40.741879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:40.871207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:40.879768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:40.881278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:40.882501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-47e56814-d381-477f-a487-e39eca8a5923 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154076 May 16 17:16:40.883073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1210/2109] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:41.900556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:41.901180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:41.907646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:41.908101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:41.908885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:41.909327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:42.051172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:42.062639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:42.064581 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:42.065787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-942398b7-af19-4466-b9be-c9dcfd4f5cfa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.169178 May 16 17:16:42.066347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 900/2110] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:43.085031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:43.085659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:43.092469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:43.092922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:43.093696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:43.094157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:43.221728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:43.230069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:43.231571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:43.232742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8b62a53a-3e64-4995-b9b7-f95194311037 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152253 May 16 17:16:43.233311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1211/2111] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:44.251297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:44.251889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:44.258853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:44.259308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:44.260090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:44.260532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:44.389832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:44.398292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:44.399830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:44.401007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7cdfc797-2bd3-4650-97ec-d3cb1a5be4fb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153659 May 16 17:16:44.401570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 901/2112] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:45.368995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:16:45.369507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:16:45.419482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:45.420098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:45.426282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:45.426723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:45.427491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:45.427934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:45.708092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:45.717405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:45.718964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:45.720174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c2269f13-168c-4760-a683-fadf85a3d986 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.304811 May 16 17:16:45.720754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1212/2113] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:46.739437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:46.740011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:46.746107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:46.746567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:46.747337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:46.747779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:46.858625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:16:46.858873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de (ip 10.222.0.70) !!! May 16 17:16:46.880114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:46.888822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:46.890371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:46.891538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3b7daea6-e67f-4317-97e1-642109c57ecc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156324 May 16 17:16:46.892097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 902/2114] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:47.910406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:47.911023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:47.917840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:47.918289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:47.919045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:47.919484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:48.047745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:48.055815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:48.057307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:48.058507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-211ba387-6585-4fd0-aaa3-aafa6eb4aa3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152033 May 16 17:16:48.059064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1213/2115] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:49.076520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:49.077120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:49.083593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:49.084051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:49.084838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:49.085282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:49.211664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:49.219732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:49.221234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:49.222430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-59d7dab8-3435-410e-b45f-114fdc8ad99a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149895 May 16 17:16:49.222990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 903/2116] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:50.241358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:50.241988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:50.248215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:50.248657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:50.249412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:50.249870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:50.375846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:50.383951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:50.385433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:50.386619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-39687af0-9eb3-488c-9212-685a79eaa29f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149140 May 16 17:16:50.387169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1214/2117] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:51.405525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:51.406107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:51.412614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:51.413071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:51.414303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:51.414303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:51.545554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:51.554106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:51.555606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:51.556786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7d026fd-3ea0-4137-9080-7771f73b5403 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155366 May 16 17:16:51.557407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 904/2118] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:52.575130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:52.575746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:52.582217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:52.582666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:52.583442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:52.584045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:52.716018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:52.724440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:52.725959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:52.727120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8b924c3d-1090-46c2-b059-1cb975b5c0b7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155947 May 16 17:16:52.727687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1215/2119] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:53.745311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:53.745954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:53.753400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:53.754254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:53.756145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:53.756917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:53.886170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:53.894596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:53.896117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:53.897980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-141be226-2742-4cf9-8f6a-1be298a2d6b4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156689 May 16 17:16:53.898548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 905/2120] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:54.917064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:54.917674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:54.924204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:54.924663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:54.925444 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:54.925920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:55.051320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:55.060705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:55.062249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:55.063452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-11666da1-c67f-44a0-a91b-dd8c7be619b8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150987 May 16 17:16:55.064016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1216/2121] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:56.203811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:56.204428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:56.210785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:56.211514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:56.212277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:56.212708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:56.228353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:16:56.228866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:16:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:16:56.341191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:56.350339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:56.351835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:56.353004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-df5b7383-f3c9-4bf2-b0b2-401d36f2825c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.274656 May 16 17:16:56.353562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 906/2122] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:57.371576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:57.372196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:57.378753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:57.379197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:57.379959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:57.380957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:57.511515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:57.519870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:57.521995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:57.523154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4df82610-8a69-4584-8531-9fbe78771c35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155595 May 16 17:16:57.523714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1217/2123] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:58.542013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:58.542598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:58.548991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:58.549453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:58.550264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:58.550711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:58.687717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:58.696071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:58.697588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:58.698804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0884006-6484-4b6c-acd7-6af2626eb37d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160871 May 16 17:16:58.699368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 907/2124] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:16:59.717916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:16:59.718442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:16:59.724732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:59.725183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:59.725971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:16:59.726409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:16:59.851383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:59.859504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:59.860999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:16:59.862223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f40d42de-7d3a-4d0b-be30-68db865a4579 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148283 May 16 17:16:59.862789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1218/2125] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:16:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:00.879853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:00.880532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:00.886851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:00.887307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:00.888071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:00.888510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:01.014346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:01.023026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:01.024528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:01.025690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-053a4105-eedf-41c3-afdd-46da2eb151e0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149784 May 16 17:17:01.026272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 908/2126] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:02.043900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:02.044520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:02.050905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:02.051353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:02.052121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:02.053199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:02.176895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:02.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:02.186777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:02.187943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8f58b3fc-daa5-4555-8e86-d189103a332c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147979 May 16 17:17:02.188506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1219/2127] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:02.462145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:17:02.462365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:17:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:17:03.206767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:03.207373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:03.218224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:03.218677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:03.219459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:03.219897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:03.352766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:03.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:03.362636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:03.363809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c6ff9ced-0b03-485a-b14e-74a535d14c67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.161021 May 16 17:17:03.364366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 909/2128] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:04.382898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:04.383549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:04.389895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:04.390338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:04.391094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:04.391522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:04.788672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:04.797446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:04.798987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:04.800200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-df18c2a2-639e-465c-8054-208150baa515 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.421314 May 16 17:17:04.800786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1220/2129] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:05.818944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:05.819490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:05.825892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:05.826344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:05.827119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:05.827556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:05.954642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:05.963719 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:05.965222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:05.966512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7e36d4a2-157f-4f76-9fa5-92dd8d0f1c22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152166 May 16 17:17:05.967068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 910/2130] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:06.984135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:06.984733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:06.991646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:06.992092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:06.992853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:06.993283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:07.120922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:07.129369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:07.130899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:07.132071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-814ddbd5-ce27-4240-ae02-84a5952c09d7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151867 May 16 17:17:07.132637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1221/2131] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:08.151861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:08.152468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:08.159030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:08.159479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:08.160252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:08.160684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:08.339548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:08.347817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:08.349975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:08.351153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b7b71d3f-262f-4bbc-95c6-85698eb6687c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.204891 May 16 17:17:08.351716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 911/2132] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:09.369362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:09.370006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:09.376514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:09.376983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:09.377758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:09.378193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:09.506027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:09.514186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:09.515671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:09.516900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d98779ed-dd8a-4ccb-a78a-d89b5ef83d1f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151399 May 16 17:17:09.517380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1222/2133] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:10.535749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:10.536360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:10.543447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:10.543902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:10.544707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:10.545119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:10.674598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:10.682946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:10.684450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:10.685652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9668c792-b981-458e-b577-4d4b86ab5be3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153841 May 16 17:17:10.686263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 912/2134] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:11.704260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:11.704808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:11.711965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:11.712442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:11.713201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:11.713638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:11.836044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:11.844106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:11.845599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:11.846787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d2280b78-350c-441a-8bf1-eef61f512805 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146512 May 16 17:17:11.847352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1223/2135] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:12.865524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:12.866152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:12.872687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:12.873137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:12.873942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:12.874377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:12.998251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:13.007092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:13.008574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:13.009755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dcdebf9a-7ab4-4688-8ef3-d44313d4549b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148670 May 16 17:17:13.010331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 913/2136] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:14.028488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:14.029094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:14.035407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:14.035860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:14.037127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:14.037562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:14.162642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:14.170706 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:14.172187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:14.173332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d2f0506f-0c57-46d6-97f2-ee0b5095a411 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148848 May 16 17:17:14.173929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1224/2137] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:15.192161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:15.192784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:15.199218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:15.199676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:15.200452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:15.200893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:15.341586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:15.349903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:15.351410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:15.352586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55dac825-cda4-471f-9dc3-87e60b76c671 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.164296 May 16 17:17:15.353150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 914/2138] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:16.371138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:16.371771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:16.378346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:16.378794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:16.379560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:16.380021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:16.511653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:16.520295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:16.522341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:16.523513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e698b363-34f8-4149-b577-3031e4bd571b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156418 May 16 17:17:16.524106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1225/2139] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:17.545660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:17.546401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:17.553785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:17.554333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:17.555102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:17.555600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:17.683820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:17.692109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:17.693691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:17.694894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76ab8547-94dd-46cb-89b9-398b7646dd95 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153498 May 16 17:17:17.695463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 915/2140] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:18.714640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:18.715188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:18.721460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:18.721947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:18.722713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:18.723152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:18.847605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:18.855748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:18.857249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:18.858453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-edc3a46a-21c7-4744-9aac-2c6c0a7cfbf2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148073 May 16 17:17:18.859015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1226/2141] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:19.876579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:19.877181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:19.883660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:19.884115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:19.884893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:19.885327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:20.012071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:20.020638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:20.022171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:20.023353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f4d8916a-44a0-4d16-98fe-16735156aa0d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150748 May 16 17:17:20.023909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 916/2142] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:21.042192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:21.042813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:21.049073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:21.049527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:21.050330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:21.050774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:21.178187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:21.186379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:21.187873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:21.189031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3a34c9b9-913b-45a4-a2ad-79b6402a7896 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150770 May 16 17:17:21.189594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1227/2143] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:22.208036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:22.208678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:22.215401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:22.215852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:22.216621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:22.217057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:22.344905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:22.353586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:22.355132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:22.356292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d2cdb93f-25c2-45fd-aa70-58ae6f57d260 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152233 May 16 17:17:22.357031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 917/2144] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:23.375524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:23.376133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:23.383069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:23.383509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:23.384257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:23.384688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:23.507810 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:23.516067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:23.517548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:23.518724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d050e51d-4932-4cd9-9371-5734e62c3893 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147088 May 16 17:17:23.519274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1228/2145] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:24.536621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:24.537237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:24.543483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:24.543928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:24.544685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:24.545116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:24.669443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:24.677585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:24.679094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:24.680248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ff22143a-3c8d-458e-a93e-540cf80d1a32 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147669 May 16 17:17:24.680825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 918/2146] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:25.698747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:25.699379 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:25.705620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:25.706109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:25.706867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:25.707304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:25.836785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:25.845047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:25.846582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:25.847742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f31f6292-86b0-4835-8abb-b25e06b1c48c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152951 May 16 17:17:25.848330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1229/2147] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:26.866158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:26.866818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:26.872981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:26.873431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:26.874224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:26.874657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:27.001381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:27.010439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:27.011951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:27.013118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-09ead024-b673-4078-af89-9d5d73780b67 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150941 May 16 17:17:27.013684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 919/2148] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:28.031496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:28.032112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:28.038404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:28.038851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:28.039608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:28.040042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:28.163069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:28.171473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:28.172988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:28.174224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a9d6d4b3-3c52-448d-81f1-1732ad6479f1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146649 May 16 17:17:28.174793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1230/2149] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:29.193997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:29.194607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:29.200805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:29.201249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:29.202036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:29.202469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:29.327623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:29.336047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:29.337551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:29.338767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e683e010-9459-4413-85ee-6a611ee0d032 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149231 May 16 17:17:29.339340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 920/2150] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:30.356429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:30.357035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:30.363252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:30.363696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:30.365183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:30.365619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:30.490840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:30.499184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:30.500679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:30.501864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-82919b78-f02f-4625-a686-96cd23263840 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149378 May 16 17:17:30.502427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1231/2151] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:31.520974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:31.521586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:31.527950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:31.528403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:31.529173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:31.529615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:31.657481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:31.667138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:31.668683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:31.669912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55f0ffbd-e678-47be-be0f-7d39c79c7420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153452 May 16 17:17:31.670485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 921/2152] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:32.689077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:32.689647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:32.695831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:32.696289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:32.697024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:32.697454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:32.825898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:32.834000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:32.835751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:32.836899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6063303d-101b-4320-a403-9054d932d463 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152755 May 16 17:17:32.837473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1232/2153] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:33.855325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:33.855963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:33.862221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:33.862668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:33.863427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:33.864402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:33.991007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:33.999214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:34.000716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:34.001905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1b6c8c19-4c12-4001-8743-af8f4f271d82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150493 May 16 17:17:34.002460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 922/2154] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:35.020720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:35.021326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:35.027678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:35.028130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:35.028898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:35.029334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:35.154058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:35.165371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:35.166882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:35.168870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1ecfface-017a-44ba-bdb7-ffd82d5db3c8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152109 May 16 17:17:35.169582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1233/2155] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:36.187463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:36.188070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:36.195048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:36.195497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:36.196263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:36.196696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:36.319925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:36.328833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:36.330340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:36.331504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-739f5f20-2989-4918-89ec-b4056cef0261 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147929 May 16 17:17:36.332057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 923/2156] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:37.353005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:37.354637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:37.360962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:37.361417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:37.362223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:37.362659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:37.491964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:37.500290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:37.501788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:37.502938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d87b6dc6-a026-4e34-b4ea-37322586a2ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156892 May 16 17:17:37.503502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1234/2157] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:38.521791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:38.522405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:38.528901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:38.529357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:38.530181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:38.530622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:38.657543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:38.665687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:38.667158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:38.668316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b576c50b-f196-4fc2-964d-6750eb713063 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151091 May 16 17:17:38.668876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 924/2158] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:39.686958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:39.687556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:39.693895 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:39.694348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:39.695108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:39.695541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:39.818441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:39.826613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:39.828101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:39.829254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9e26404a-5617-4eda-8cfd-7a50ede25666 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.146230 May 16 17:17:39.829827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1235/2159] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:40.588047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.595194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.595657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.596480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.596930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.610803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 HTTP/1.1 May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:17:40.612480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.614038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '84cea648-3cec-4a36-b8ee-02d2f4ee9097'} May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:17:40.615220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.616496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.617855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:17:40.617855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f494572-aee8-4ff7-be36-8d3c30eda217 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 404 len: 111 microversion: 2.1 time: 0.029887 May 16 17:17:40.617855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 925/2160] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:17:40 2022] DELETE /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:17:40.628126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.628621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.634632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.635184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.635841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.636085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.636459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 84cea648-3cec-4a36-b8ee-02d2f4ee9097] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.636657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.642372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.642832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.643615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.644051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.658087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 HTTP/1.1 May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:17:40.659748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.661055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '84cea648-3cec-4a36-b8ee-02d2f4ee9097'} May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:17:40.662532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. May 16 17:17:40.663761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.664838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 84cea648-3cec-4a36-b8ee-02d2f4ee9097 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:17:40.664838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4eccc1a7-a81f-4e78-85dc-96021fe4af85 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097" status: 404 len: 111 microversion: 2.1 time: 0.029042 May 16 17:17:40.664838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 926/2161] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:40 2022] GET /compute/v2.1/servers/84cea648-3cec-4a36-b8ee-02d2f4ee9097 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:17:40.671249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:17:40.671409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.671409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.677504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.678061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.678911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.679580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.694786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d HTTP/1.1 May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:17:40.698243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.699840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '33c9ac7f-ecb0-453c-91c2-191f32b2958d'} May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:17:40.700812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.702159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.703551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:17:40.703551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7b151ad9-b6a9-4fb7-bb29-8559e5459b9a tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 404 len: 111 microversion: 2.1 time: 0.032821 May 16 17:17:40.703551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 927/2162] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:17:40 2022] DELETE /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:17:40.708933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.709539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: 33c9ac7f-ecb0-453c-91c2-191f32b2958d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.715861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.716313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.717082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.717521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.731703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d HTTP/1.1 May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:17:40.733218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.735013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '33c9ac7f-ecb0-453c-91c2-191f32b2958d'} May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:17:40.736049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. May 16 17:17:40.737627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:17:40.738997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance 33c9ac7f-ecb0-453c-91c2-191f32b2958d could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:17:40.738997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-82e6a067-2d60-4fd7-a93d-e050f1fffaf4 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d" status: 404 len: 111 microversion: 2.1 time: 0.030025 May 16 17:17:40.738997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 928/2163] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:40 2022] GET /compute/v2.1/servers/33c9ac7f-ecb0-453c-91c2-191f32b2958d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:17:40.755848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ede2d929-f17c-4564-8b04-e47eb32ffa51 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 204 len: 0 microversion: 2.1 time: 0.131274 May 16 17:17:40.756464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1236/2164] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:17:40 2022] DELETE /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 17:17:40.764325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.764924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.771252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.771708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.772466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.772900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.848502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:40.848842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:40.854805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.855282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.856088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:40.856515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:40.901658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:40.909922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fd0b9e88-e656-43b5-be51-26de67f631c5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149272 May 16 17:17:40.910625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 929/2165] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:40 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:40.992769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:41.001385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:41.002913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:41.004082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e7c41d34-cb49-4272-9c11-45cccf4472db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160362 May 16 17:17:41.004653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1237/2166] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:41.928325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:41.929089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:41.935490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:41.935949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:41.936725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:41.937170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:42.022867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:42.023562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:42.030731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:42.031363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:42.032512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:42.033128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:42.069625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:42.078180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f1f4ccd-812c-45dd-8704-ff34819adfe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153776 May 16 17:17:42.080205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 930/2167] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:41 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:42.165248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:42.173457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:42.174996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:42.176149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f981eb58-dda4-49b7-80aa-f649f99ed22a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157264 May 16 17:17:42.176722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1238/2168] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:43.095354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:43.096004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:43.102341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:43.102796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:43.103565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:43.104003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:43.194596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:43.195217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:43.203729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:43.204211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:43.204984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:43.205421 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:43.230023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:43.237803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f5fca52-85c3-4789-a346-3b05528aa1b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146527 May 16 17:17:43.238580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 931/2169] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:43 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:43.331016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:43.340060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:43.341548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:43.342732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1614bc36-5a8d-40fd-8ade-bca1d5b35e7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152706 May 16 17:17:43.343294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1239/2170] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:44.254883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:44.256185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:44.262551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:44.263010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:44.263783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:44.264229 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:44.360333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:44.360936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:44.367611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:44.368061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:44.368909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:44.369362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:44.387616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:44.395371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7b5518b0-57d5-42e6-8c52-0bfc3fb2f97a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144459 May 16 17:17:44.395981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 932/2171] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:44 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:44.499150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:44.508206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:44.509640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:44.510860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-94a59088-86de-4cea-9dfd-2008eaea1a47 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154375 May 16 17:17:44.511425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1240/2172] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:45.413062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:45.413659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:45.419659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:45.420113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:45.420880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:45.421321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:45.529850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:45.530496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:45.537159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:45.537600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:45.538407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:45.538833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:45.554606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:45.562384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-746f9129-176a-4d65-911f-20d2e21d4645 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153960 May 16 17:17:45.562956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 933/2173] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:45 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:45.665854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:45.673927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:45.675415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:45.676597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7f29ba22-99db-4a43-8218-ac4c121bf2c3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150594 May 16 17:17:45.677825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1241/2174] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:46.579497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:46.580147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:46.587244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:46.587696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:46.588469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:46.588907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:46.695606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:46.696230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:46.702506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:46.702960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:46.703730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:46.704166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:46.714162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:46.721959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-46a5ca76-9517-42a0-a100-49d7b179dc9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146316 May 16 17:17:46.722609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 934/2175] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:46 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:46.835796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:46.843997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:46.845486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:46.846670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d6cef8e6-1aee-47fd-8b95-f5cea85cbdc3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155025 May 16 17:17:46.847229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1242/2176] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:47.739427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:47.740034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:47.746373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:47.746822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:47.747615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:47.748050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:47.865116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:47.865816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:47.871918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:47.872365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:47.875774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:47.876720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:47.877179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:47.884074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5babb49e-8290-4b54-a6c6-605c29fc1205 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148472 May 16 17:17:47.884635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 935/2177] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:47 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:48.002125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:48.010743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:48.012223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:48.013367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-92281a02-0f81-4164-9c11-435d049387d3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152165 May 16 17:17:48.013967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1243/2178] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:48.901347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:48.902000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:48.908393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:48.908853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:48.909624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:48.910102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:49.031729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:49.032339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:49.033690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:49.039545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:49.040161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:49.040953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:49.041382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:49.042084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5da858ec-c8d5-43be-bad4-a0843bff7f26 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144590 May 16 17:17:49.042653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 936/2179] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:48 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:49.165777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:49.174027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:49.175528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:49.176685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cdbf921d-daba-4b8b-bb58-5ff14dfd38f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148883 May 16 17:17:49.177252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1244/2180] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:50.059317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:50.059991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:50.066197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:50.066642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:50.067404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:50.067837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:50.195159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:50.195884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:50.199362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:50.202456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:50.202915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:50.203694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:50.204133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:50.207252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-02aaf1c7-4214-43e5-af81-c57c2c257f62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151812 May 16 17:17:50.208768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 937/2181] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:50 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:50.335724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:50.343761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:50.345242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:50.346416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-49073a93-a78e-478c-8400-bb704e4da2af tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155319 May 16 17:17:50.346974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1245/2182] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:51.224524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:51.225070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:51.231965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:51.232414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:51.233180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:51.233618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:51.357761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:51.364304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:51.364986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:51.365507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12b0da73-98c0-4727-9d92-f22c5e547bac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144973 May 16 17:17:51.366150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 938/2183] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:51 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:51.373173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:51.374002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:51.375088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:51.375532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:51.507241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:51.515788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:51.517276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:51.518472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fadad155-f494-497c-b5b8-1b4b62fb30f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158043 May 16 17:17:51.519036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1246/2184] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:52.383156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:52.383773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:52.390133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:52.390591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:52.391362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:52.391804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:52.516616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:52.524488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-647df998-ab40-4b1d-ad65-bafd255cc553 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145800 May 16 17:17:52.524994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 939/2185] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:52 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:52.537902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:52.538477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:52.544795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:52.545252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:52.546047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:52.546493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:52.674018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:52.683600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:52.685389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:52.686668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-78c3d431-2136-409f-b8d1-af8fcaa96681 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152872 May 16 17:17:52.687228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1247/2186] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:53.541520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:53.542089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:53.548304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:53.548753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:53.549513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:53.549975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:53.677585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:53.685280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-65921937-0596-4cf4-baf5-08770d6c698c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147829 May 16 17:17:53.685858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 940/2187] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:53 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:53.705574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:53.706217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:53.713283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:53.713727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:53.714499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:53.714928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:53.838327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:53.846530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:53.848090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:53.849190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-917cb79e-2d02-4e64-81bc-5aa40d7b0d22 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147477 May 16 17:17:53.849759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1248/2188] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:54.703813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:54.704370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:54.711668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:54.712113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:54.712876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:54.713336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:54.838361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:54.846127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12aaa4d4-1648-49ed-8011-4ad027346b52 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146320 May 16 17:17:54.846690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 941/2189] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:54 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:54.868622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:54.869234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:54.875622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:54.876065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:54.876823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:54.877258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:55.001275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:55.010426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:55.012011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:55.013506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9d5a45cf-0be1-4733-8ad2-8cd045d9f0ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148768 May 16 17:17:55.014258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1249/2190] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:17:55.863833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:55.864451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:55.871175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:55.871622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:55.872401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:55.872838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:56.032606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:56.033155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:56.040599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:56.041051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:56.041902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:56.042358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:56.070091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:56.078304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7a8e244e-cfbf-4544-9182-bdf53e130284 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.218240 May 16 17:17:56.079174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 942/2191] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:55 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:56.181911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:56.190960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:56.191667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:56.192835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d3372421-3cc7-427c-92da-d8e417bcaee5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.164281 May 16 17:17:56.193402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1250/2192] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:57.096188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:57.097261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:57.106437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:57.106881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:57.107879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:57.108379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:57.211957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:57.213296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:57.220132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:57.220827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:57.222129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:57.222572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:57.250044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:57.257866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2ceafe53-870b-4c42-97f6-ee124637a4a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.166653 May 16 17:17:57.258815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 943/2193] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:57 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:57.351976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:57.360830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:57.362357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:57.363526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cffd000c-2456-4d6d-94c8-3eb2ea5116f3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155989 May 16 17:17:57.364096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1251/2194] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:58.275507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:58.276129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:58.282672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:58.283128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:58.283893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:58.284328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:58.381695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:58.382515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:58.389723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:58.390279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:58.391111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:58.391552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:58.416156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:58.424103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b01b51ca-8b1b-4a92-ac39-36f3aad0ddc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153111 May 16 17:17:58.424769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 944/2195] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:58 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:58.522704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:58.530913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:58.532341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:58.533491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-236baa86-7114-4dbb-96df-e079dd062418 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155897 May 16 17:17:58.534084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1252/2196] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:17:59.442084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:59.442626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:59.449501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:59.449981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:59.450746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:59.451181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:59.555110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:17:59.556807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:17:59.563517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:59.563971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:59.564758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:17:59.565193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:17:59.579714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:59.588591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-624a05c8-3693-44d5-8613-bef0cf6b2301 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150729 May 16 17:17:59.589626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 945/2197] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:17:59 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:17:59.692705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:59.701136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:59.702654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:17:59.703832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-42e3684c-b7d4-4a83-aff2-abd2513aaf1a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155946 May 16 17:17:59.704389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1253/2198] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:17:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:00.609567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:00.610275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:00.616645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:00.617086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:00.618394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:00.618828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:00.722313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:00.723030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:00.729397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:00.729975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:00.730804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:00.731348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:00.746436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:00.754757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-af89c9a4-ba07-4307-96e3-a3ab5775ce0b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149443 May 16 17:18:00.755328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 946/2199] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:00 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:00.859095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:00.867298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:00.869267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:00.870458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6acd9c0e-b2cc-4b85-95e5-16bb42091a45 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152112 May 16 17:18:00.871026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1254/2200] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:01.772322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:01.772939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:01.779458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:01.779915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:01.780678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:01.781117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:01.888108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:01.888746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:01.895161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:01.895610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:01.896380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:01.896818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:01.907926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:01.916317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-47d5bc04-ae8b-4eec-9005-2727943d8367 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147944 May 16 17:18:01.916953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 947/2201] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:01 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:02.023861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:02.032069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:02.033572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:02.034758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-27644360-c848-4df4-b7d6-9a8d7ec3c448 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150798 May 16 17:18:02.035316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1255/2202] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:02.933626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:02.934270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:02.940758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:02.941210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:02.942016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:02.942455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:03.053365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:03.054047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:03.060738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:03.061188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:03.061985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:03.062427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:03.073654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:03.081604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7e19e3c0-9a2e-4981-8e6a-bcccf29dac15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152311 May 16 17:18:03.082979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 948/2203] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:02 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:03.191726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:03.200525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:03.202095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:03.203259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-87b1e077-b4ad-4f70-ac9f-3e107863e46a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153837 May 16 17:18:03.203814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1256/2204] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:04.099661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:04.100310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:04.106747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:04.107194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:04.107954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:04.108387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:04.222208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:04.222820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:04.229235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:04.229681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:04.230523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:04.230980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:04.237675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:04.245763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b1b8b918-9ea0-491a-a4c3-b9c0dae0dc1c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149948 May 16 17:18:04.246352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 949/2205] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:04 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:04.358795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:04.367131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:04.369131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:04.370320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2bf20fda-6aec-4c54-87d0-80316971fcbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152118 May 16 17:18:04.370889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1257/2206] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:05.263482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:05.264175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:05.270680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:05.271139 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:05.271923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:05.272382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:05.388571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:05.390553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:05.395567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:05.396007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:05.396778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:05.397219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:05.405560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:05.419078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3d6003c8-14c8-4612-8f4a-768fd8284918 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.159710 May 16 17:18:05.420025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 950/2207] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:05 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:05.550249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:05.559143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:05.560668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:05.561866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d03afea-cde9-4965-8600-6b337599a43a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.177150 May 16 17:18:05.562435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1258/2208] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:06.444414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:06.445028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:06.452727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:06.453179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:06.453993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:06.454459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:06.580560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:06.581266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:06.589372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:06.589695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:06.589876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:06.591023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:06.591462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:06.598103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ef7f6810-87bc-407e-bf50-670a4744bbd9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.157474 May 16 17:18:06.598689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 951/2209] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:06 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:06.720833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:06.728960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:06.730481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:06.731644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ac82e6d0-b3ae-44fe-b389-45e03959ec46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155037 May 16 17:18:06.732205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1259/2210] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:07.615156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:07.615796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:07.622548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:07.622997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:07.623761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:07.624195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:07.748159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:07.750752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:07.751367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:07.756107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-74720f6a-cc25-438f-8e96-a4add693a617 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144759 May 16 17:18:07.756677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 952/2211] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:07 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:07.757723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:07.758213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:07.759037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:07.759472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:07.886096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:07.894193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:07.895975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:07.896861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-16ae78a8-80be-4ced-85df-e4ba7b9241f5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150088 May 16 17:18:07.897427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1260/2212] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:08.772387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:08.772952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:08.779816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:08.780265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:08.781021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:08.781457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:08.905234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:08.913082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c81372d3-b9e4-44a5-a42d-9632cec3dc68 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144548 May 16 17:18:08.913658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 953/2213] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:08 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:08.914408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:08.915027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:08.921930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:08.922382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:08.923150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:08.923582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:09.047857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:09.056490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:09.058009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:09.059162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-abb86043-7977-451b-b36a-e2d0b301313f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148608 May 16 17:18:09.059714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1261/2214] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:09.929115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:09.929758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:09.936065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:09.936513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:09.937418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:09.937713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:10.063173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:10.070968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a8c63264-2165-456a-8272-d0f907174f11 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145749 May 16 17:18:10.072133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 954/2215] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:09 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:10.076974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:10.077594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:10.084576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:10.085294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:10.086082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:10.086524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:10.217369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:10.227930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:10.229432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:10.230638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ccf3adb7-849a-408a-8a97-59017b002372 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157543 May 16 17:18:10.231204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1262/2216] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:11.089243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:11.089894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:11.096472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:11.096921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:11.097677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:11.098133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:11.222388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:11.230938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bd4c1962-9eaf-41a2-97bd-02b9c394bd41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146401 May 16 17:18:11.231506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 955/2217] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:18:11.248922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:11.249528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:11.256404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:11.256851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:11.257612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:11.258094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:11.381659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:11.389832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:11.391358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:11.392510 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a1778248-17d2-48a8-ba1e-96140ad53d4a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147888 May 16 17:18:11.393070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1263/2218] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:12.248582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:12.249255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:12.255580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:12.256036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:12.256810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:12.257244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:12.386564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:12.394325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7ea13097-1627-4270-87dc-b27b17aa3a75 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150275 May 16 17:18:12.394901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 956/2219] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:12 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:12.411231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:12.411846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:12.418655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:12.419101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:12.419861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:12.420295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:12.549433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:12.558196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:12.559691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:12.560837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8bda739c-a6d4-4cbc-a354-3fcefc11a504 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153544 May 16 17:18:12.561434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1264/2220] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:13.411161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:13.411758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:13.418295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:13.418749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:13.419527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:13.419993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:13.544913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:13.552548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2fb6598c-e4ee-4f87-a2de-6c7f7fc9af80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145334 May 16 17:18:13.553121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 957/2221] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:13.579242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:13.579880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:13.586448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:13.586896 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:13.587655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:13.588088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:13.715017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:13.723111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:13.724596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:13.725780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-75287e4f-e971-4c02-a4c8-df397ec01256 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150474 May 16 17:18:13.726348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1265/2222] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:14.570078 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:14.570683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:14.577290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:14.577789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:14.578561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:14.578998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:14.706992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:14.715312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3c54eaca-7b54-4b18-a350-a4052d8617a0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149158 May 16 17:18:14.715909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 958/2223] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:14 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:14.744947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:14.746448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:14.752106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:14.752552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:14.753301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:14.753732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:14.880648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:14.888890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:14.890432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:14.891599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0d8c229a-fa11-4194-8362-2b4707704369 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150676 May 16 17:18:14.892164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1266/2224] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:15.731739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:15.732378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:15.738559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:15.739017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:15.739818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:15.740262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:15.863616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:15.871985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-07f113db-3fb0-4b6d-aaa8-7dad2cd72a56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144373 May 16 17:18:15.872556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 959/2225] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:15 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:15.911251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:15.911858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:15.918556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:15.918998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:15.919754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:15.920182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:16.044823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:16.052932 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:16.054443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:16.055601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-273a8ab3-e043-4bf3-b5d5-6944e3c8dd8a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148866 May 16 17:18:16.056156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1267/2226] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:16.889827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:16.890508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:16.896709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:16.897166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:16.897960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:16.898397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:17.023422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:17.031140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-57c52cf2-43fc-4a64-97d1-5778c27e0b32 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145771 May 16 17:18:17.031721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 960/2227] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:16 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:17.075070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:17.075683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:17.081953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:17.082399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:17.083155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:17.083590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:17.207763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:17.216225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:17.217718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:17.218892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b1830cd-1e1c-4c19-840f-d0596a17a813 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148308 May 16 17:18:17.219453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1268/2228] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:18.048114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:18.048711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:18.054992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:18.055442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:18.056199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:18.056635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:18.186200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:18.194004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1dd58ad7-15c4-4683-9f25-393e8be1ab00 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149782 May 16 17:18:18.194574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 961/2229] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:18.237607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:18.238249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:18.244576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:18.245020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:18.245804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:18.246889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:18.375385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:18.383453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:18.384958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:18.386153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fd74579a-1e85-4dd3-896f-88d900f826e1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152433 May 16 17:18:18.386718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1269/2230] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:19.211598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:19.212211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:19.219117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:19.219566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:19.220326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:19.220760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:19.343653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:19.351373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae26ddcd-3f01-42b4-8553-ca8615805dba tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144419 May 16 17:18:19.351955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 962/2231] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:19 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:19.404497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:19.405439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:19.411981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:19.412424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:19.413179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:19.413606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:19.538567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:19.546636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:19.548117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:19.549301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fcc5b5cd-f1ec-4c6c-b84c-c77c70890489 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149011 May 16 17:18:19.549901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1270/2232] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:20.368179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:20.368788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:20.375057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:20.375506 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:20.376460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:20.376899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:20.505668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:20.513910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dacca8bb-5fbc-42a6-8c22-363a1a0ec12a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149567 May 16 17:18:20.514485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 963/2233] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:20 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:20.568529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:20.569250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:20.575946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:20.576393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:20.577150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:20.577585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:20.708834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:20.717968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:20.719483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:20.720640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9334d04e-0e68-40f1-ab38-a87c3a55ca04 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156146 May 16 17:18:20.721258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1271/2234] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:21.531483 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:21.532025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:21.538238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:21.538685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:21.539443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:21.539878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:21.664722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:21.673007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9f8646a8-40e2-4a46-9f8f-652b7eac162d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146099 May 16 17:18:21.673578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 964/2235] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:21 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:21.738498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:21.739117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:21.745372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:21.745862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:21.747173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:21.747610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:21.873990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:21.884873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:21.886517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:21.887952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a8988244-37f8-4aa4-9b21-c7ce3607e93a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153360 May 16 17:18:21.888748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1272/2236] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:22.690269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:22.690874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:22.697113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:22.697569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:22.698395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:22.698837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:22.823680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:22.831904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fe4f68d-4905-4973-a49c-96e3e0b85f5b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145878 May 16 17:18:22.832477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 965/2237] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:22 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:22.906845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:22.907479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:22.913701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:22.914186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:22.914950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:22.915389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:23.040436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:23.048497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:23.050035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:23.051199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-795a7430-f74c-43d0-9154-fee66aad1ab2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148805 May 16 17:18:23.051762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1273/2238] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:23.849604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:23.850245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:23.856467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:23.857191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:23.858039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:23.858472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:23.986511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:23.994316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2f9557ef-6c14-4a78-964d-fd6a5c1fb7a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148614 May 16 17:18:23.994884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 966/2239] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:24.069805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:24.070448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:24.077354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:24.077833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:24.078619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:24.079057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:24.208280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:24.216731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:24.218261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:24.219426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-df67a00d-9adc-4b70-9828-bd87839ba6e9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153528 May 16 17:18:24.219993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1274/2240] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:25.012944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:25.013588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:25.019923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:25.020407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:25.021177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:25.021617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:25.147600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:25.155891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ac99b2a7-e5a9-439d-8b17-09b6dfc079d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147338 May 16 17:18:25.156470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 967/2241] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:25 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:25.238121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:25.238730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:25.245025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:25.245470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:25.246917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:25.247410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:25.375929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:25.384137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:25.385625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:25.387439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e3c5b333-ef77-47dc-9a75-bb743c19ca0a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152856 May 16 17:18:25.387998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1275/2242] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:26.172998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:26.173614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:26.179957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:26.180412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:26.181182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:26.181622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:26.306915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:26.314609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-41d14305-2e2b-447b-9b84-3f0ca1298473 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145513 May 16 17:18:26.315177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 968/2243] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:26 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:26.406432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:26.407044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:26.413518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:26.413991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:26.414756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:26.415185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:26.544315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:26.552406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:26.553903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:26.555059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-36705598-69a1-4802-b0fa-5c8863e2a9e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153254 May 16 17:18:26.555614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1276/2244] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:27.331400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:27.332019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:27.338649 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:27.339104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:27.340437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:27.340877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:27.466600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:27.474319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-316187ac-1d0e-47b5-8140-6e7a9a2ebb8c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146808 May 16 17:18:27.474896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 969/2245] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:27.573175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:27.573817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:27.581170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:27.581622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:27.582417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:27.582864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:27.710889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:27.719059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:27.720478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:27.721617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-baf3d5f0-432f-49fd-b57a-491652616fb4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152385 May 16 17:18:27.722208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1277/2246] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:28.491012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:28.491633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:28.498043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:28.498571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:28.499344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:28.499782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:28.628082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:28.635741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5add9be9-c1b4-4ee7-86a2-b0190f9ed87a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148593 May 16 17:18:28.636312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 970/2247] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:28.739881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:28.740511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:28.747243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:28.747689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:28.748449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:28.748889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:28.879877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:28.888126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:28.889618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:28.890821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-408e9f7c-7110-4bb0-bae3-aa6086111727 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154941 May 16 17:18:28.891618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1278/2248] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:29.653023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:29.653639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:29.659987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:29.660437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:29.661214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:29.661651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:29.786067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:29.793804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a9644204-ddab-42e6-a4e0-d3aad9596d15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145207 May 16 17:18:29.794376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 971/2249] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:29 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:29.909720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:29.910318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:29.916519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:29.916958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:29.917707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:29.918165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:30.045575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:30.054013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:30.055541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:30.056734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d8de33ca-d588-4411-884e-207744bbfcaa tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151402 May 16 17:18:30.057301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1279/2250] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:30.811186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:30.811788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:30.818069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:30.818514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:30.819273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:30.819706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:30.946516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:30.954262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1f14ad37-8f40-4dc8-9627-f626551dfaec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147458 May 16 17:18:30.954825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 972/2251] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:31.075542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:31.076130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:31.082463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:31.082911 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:31.083673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:31.084115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:31.208847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:31.217344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:31.218882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:31.220030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-62b2bcbb-4e1c-44e3-85dc-97f3a45c65d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148560 May 16 17:18:31.220584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1280/2252] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:31.971749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:31.972366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:31.978668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:31.979119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:31.979883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:31.980323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:32.110472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:32.118191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e0ade5e2-7f90-416d-9707-1b4f51159fe6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150298 May 16 17:18:32.118764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 973/2253] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:31 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:32.239495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:32.240019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:32.246754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:32.247197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:32.247943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:32.248370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:32.380085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:32.388185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:32.389674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:32.390846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f4dc4259-cd92-4896-9f7f-8d2c318a0420 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155388 May 16 17:18:32.391405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1281/2254] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:33.135619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:33.136764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:33.143145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:33.143603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:33.144385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:33.144829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:33.269549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:33.277889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d053b18e-c1cf-432d-99f3-073c7617c4c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145568 May 16 17:18:33.278705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 974/2255] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:33 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:33.409492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:33.410771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:33.417579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:33.418057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:33.418836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:33.419275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:33.544799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:33.552929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:33.554450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:33.555604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c06169dc-3ff9-4e6a-b4a6-17fc164563ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150309 May 16 17:18:33.556168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1282/2256] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:34.294920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:34.295522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:34.301982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:34.302439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:34.303207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:34.303647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:34.430209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:34.438475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-37ca7345-2a3e-46c6-bd4a-c747b2f296a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147434 May 16 17:18:34.439050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 975/2257] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:34 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:34.578551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:34.579088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:34.585599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:34.586076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:34.586831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:34.587264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:34.714032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:34.722494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:34.723983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:34.725142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c644930e-5658-47dc-897a-3ad08587499d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151183 May 16 17:18:34.725695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1283/2258] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:35.455979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:35.456540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:35.463246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:35.463706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:35.465152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:35.465614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:35.594767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:35.602580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3e5bf333-d398-4324-84e2-c7529a8a68d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150608 May 16 17:18:35.603358 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 976/2259] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:35 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:35.743963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:35.744511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:35.751611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:35.752060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:35.752828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:35.753265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:35.877325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:35.885687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:35.887362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:35.888553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-318dfba9-a487-437d-9015-ce6436e03af6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148561 May 16 17:18:35.889087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1284/2260] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:36.619478 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:36.620096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:36.626887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:36.627338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:36.628106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:36.628544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:36.752298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:36.760140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-94a7c810-e80f-481b-a360-e94fd8de7172 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144512 May 16 17:18:36.760664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 977/2261] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:36 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:36.906782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:36.907340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:36.913472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:36.913953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:36.914711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:36.915149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:37.041532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:37.050134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:37.051620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:37.052780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e944888b-85ac-456a-90b6-7a96c3af7d38 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150017 May 16 17:18:37.053336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1285/2262] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:37.777418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:37.778705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:37.784938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:37.785385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:37.786176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:37.786633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:38.071839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:38.072410 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:38.079350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:38.079789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:38.080555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:38.080985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:38.179516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:38.187857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1b6e498d-d093-4cac-b2ea-12528773e5d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.414290 May 16 17:18:38.188439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 978/2263] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:37 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:38.212159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:38.220233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:38.221710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:38.222883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-57a85958-6be1-44ae-a305-2a5caf038ff0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155037 May 16 17:18:38.223504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1286/2264] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:39.204913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:39.205539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:39.212183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:39.212635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:39.213408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:39.213894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:39.240326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:39.240940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:39.247637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:39.248087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:39.252111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:39.252111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:39.348610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:39.356331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a1d5449c-7b9e-4c08-bf1d-389662ea7544 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155299 May 16 17:18:39.357109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 979/2265] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:39 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:39.380430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:39.389300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:39.391141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:39.392591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c76629ec-411d-4ecf-9de6-672a30c2b8dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156153 May 16 17:18:39.393153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1287/2266] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:40.373562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:40.374441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:40.381592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:40.382074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:40.382840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:40.383272 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:40.411014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:40.411619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:40.418309 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:40.419433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:40.420240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:40.420675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:40.511646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:40.519735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2063efea-e8ac-4a32-8fc7-314cc61189f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150096 May 16 17:18:40.520303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 980/2267] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:40 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:40.550745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:40.558903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:40.560402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:40.561558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8f154d5e-5492-449a-83d4-4ec9205d5198 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154686 May 16 17:18:40.562168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1288/2268] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:41.536611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:41.537161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:41.543469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:41.543929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:41.544695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:41.545135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:41.580332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:41.580938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:41.587532 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:41.587973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:41.588732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:41.589159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:41.676484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:41.683989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-46baf2b7-a021-4ba8-8e19-b38323cc8f16 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151367 May 16 17:18:41.684592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 981/2269] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:41 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:41.720990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:41.729156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:41.730664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:41.731890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e632890c-f525-4cf4-89b5-a2ad3fdf221d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155492 May 16 17:18:41.732455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1289/2270] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:42.701288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:42.701936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:42.708246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:42.708697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:42.709759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:42.710197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:42.750415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:42.751078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:42.757304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:42.757779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:42.758623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:42.758996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:42.840807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:42.848857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-74eaf43a-ef41-4268-9c8e-ba5ce6cff56d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152255 May 16 17:18:42.849525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 982/2271] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:42 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:42.890407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:42.898543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:42.900020 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:42.901164 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cc4de61f-5a7b-4516-a08e-817df4f05b36 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155262 May 16 17:18:42.901723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1290/2272] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:43.866616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:43.867236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:43.873636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:43.874115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:43.874890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:43.875328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:43.919759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:43.920828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:43.931689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:43.932502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:43.933928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:43.934733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:44.033679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:44.042031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eaff6f85-ed82-40e6-8c3d-cdaf5bb8a542 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.179293 May 16 17:18:44.042613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 983/2273] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:43 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:44.086040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:44.094252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:44.095758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:44.096908 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-31ead8cd-2caa-4a1a-83d5-f90466954abc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.181460 May 16 17:18:44.097489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1291/2274] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:45.060650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:45.061306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:45.067220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:45.067671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:45.068448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:45.068883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:45.115794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:45.116561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:45.123608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:45.124131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:45.124965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:45.125467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:45.204035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:45.213212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c4f2526f-625c-4903-97c0-1607f122f686 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.157450 May 16 17:18:45.213813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 984/2275] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:45 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:45.275564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:45.288820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:45.290496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:45.291759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-de3a5402-0194-48cf-b706-58960d487e4d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.180440 May 16 17:18:45.292403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1292/2276] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:46.235072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:46.235689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:46.241988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:46.242446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:46.243221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:46.243656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:46.311466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:46.312076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:46.319214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:46.319655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:46.320412 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:46.320843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:46.373816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:46.381518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-acb2e48f-9466-4f1c-9069-809cb3d9f93b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150374 May 16 17:18:46.382116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 985/2277] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:46 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:46.456629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:46.465029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:46.466543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:46.467690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ceb21d72-b325-4f3d-a881-ae0d9131c791 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.160611 May 16 17:18:46.468242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1293/2278] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:47.399135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:47.399755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:47.406212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:47.406670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:47.407452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:47.407895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:47.486553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:47.487231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:47.493570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:47.494048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:47.494805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:47.495234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:47.534526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:47.542373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bb1d9505-ed60-430c-a704-5c21116bf913 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147079 May 16 17:18:47.542961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 986/2279] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:47 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:18:47.622787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:47.630974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:47.632463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:47.633598 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61cd45ac-3e10-445b-80d8-1e261b43ff61 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150967 May 16 17:18:47.634188 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1294/2280] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:48.559227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:48.560387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:48.566675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:48.567123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:48.567883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:48.568317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:48.652797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:48.653413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:48.659668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:48.660112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:48.660863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:48.661292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:48.695943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:48.704339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1f258d76-19d6-4ee5-885f-c66cdafba5d3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148938 May 16 17:18:48.704952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 987/2281] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:48 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:48.793794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:48.801934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:48.803415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:48.804551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-953fa8cb-9534-4436-800c-f8f07c6dab7d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155735 May 16 17:18:48.805129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1295/2282] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:49.189840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:18:49.190106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:18:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:18:49.722064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:49.722787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:49.728976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:49.729430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:49.730227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:49.730669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:49.822925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:49.823664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:49.830697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:49.831150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:49.831912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:49.832342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:49.855530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:49.863321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12439635-5e0f-4a02-85c9-0a7e85b9a698 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145760 May 16 17:18:49.863890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 988/2283] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:49 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:49.957999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:49.966364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:49.967854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:49.969015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7287dd35-e7dd-4e7c-8854-5c53b584e9bc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149991 May 16 17:18:49.969580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1296/2284] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:50.880086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:50.880707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:50.887026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:50.887472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:50.888231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:50.888664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:50.987084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:50.987688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:50.993901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:50.994347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:50.995099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:50.995528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:51.017938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:51.025848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2d7ce0c3-ed2b-4e46-b5bc-c3ead9c999f0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149615 May 16 17:18:51.026423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 989/2285] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:50 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:51.120547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:51.128622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:51.130204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:51.131306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-64c938c7-8c92-469e-979c-e9e273af8625 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148669 May 16 17:18:51.131868 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1297/2286] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:52.043203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:52.043808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:52.050110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:52.050559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:52.051317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:52.051749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:52.150104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:52.150845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:52.157239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:52.157687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:52.158490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:52.158923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:52.179593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:52.187829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-84c74ecc-fbda-438f-956a-afd9d6f02c71 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148705 May 16 17:18:52.188396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 990/2287] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:52 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:18:52.288430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:52.296759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:52.298205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:52.299362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3e0c64e1-4397-425c-9a43-b9f51b55c60a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153242 May 16 17:18:52.299924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1298/2288] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:53.204586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:53.205171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:53.211776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:53.212234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:53.213001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:53.213440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:53.317523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:53.318372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:53.324621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:53.325076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:53.326854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:53.326854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:53.339900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:53.348240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-160602ef-6f82-4720-bf5e-444bdf589f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147609 May 16 17:18:53.348813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 991/2289] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:53 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:53.451749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:53.460746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:53.462206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:53.463370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-80155b76-3cac-40f1-a8cd-0bd4ded0f7ac tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149723 May 16 17:18:53.463939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1299/2290] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:54.365623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:54.366264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:54.372570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:54.373023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:54.373814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:54.378160 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:54.482209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:54.482870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:54.489081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:54.489525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:54.490314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:54.490744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:54.509184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:54.517405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8bc52b74-3d74-482a-9387-7e7fac499d27 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155714 May 16 17:18:54.518062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 992/2291] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:54 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:54.619702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:54.628281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:54.629927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:54.631093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-79e0ef45-b3db-433e-9f13-670a1f8aa82f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152756 May 16 17:18:54.631658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1300/2292] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:55.535222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:55.535770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:55.542092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:55.542541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:55.543305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:55.543739 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:55.650066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:55.650671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:55.657258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:55.657715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:55.658530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:55.659552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:55.671493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:55.679533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1fb98eaf-bb67-470c-b571-7d26bdf9b672 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149044 May 16 17:18:55.680102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 993/2293] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:55 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:55.786926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:55.795157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:55.796653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:55.797835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f2b10a1d-90c7-44a2-a525-ea131ccc0a86 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151939 May 16 17:18:55.798399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1301/2294] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:18:56.697055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:56.697667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:56.703901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:56.704623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:56.705388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:56.705884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:56.816318 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:56.816941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:56.823336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:56.823795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:56.824561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:56.825002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:56.836463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:56.850032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-87b11fe8-2a5d-4b77-bbaf-8613e69c053e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.157208 May 16 17:18:56.850835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 994/2295] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:56 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:56.954594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:56.963507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:56.965012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:56.966212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-732c4bc9-4659-4d4c-93c7-0cf5bf7d47c7 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154056 May 16 17:18:56.966784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1302/2296] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:57.867574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:57.868281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:57.874505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:57.874953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:57.875721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:57.876153 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:57.985022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:57.985595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:57.992356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:57.992809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:57.993576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:57.994036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:58.085086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:58.093396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-907935ab-deb8-40f6-a7ed-ff833725b9e9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.229722 May 16 17:18:58.103692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 995/2297] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:57 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:58.122820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:58.131002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:58.132490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:58.133681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8c5338cb-3b97-4b10-9e94-8de0c8920a4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152664 May 16 17:18:58.134275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1303/2298] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:18:59.110394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:59.111016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:59.117281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:59.117730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:59.118527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:59.118964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:59.152067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:18:59.152621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:18:59.159302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:59.159756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:59.160533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:18:59.160970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:18:59.251540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:59.260314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1eaa9177-2356-4388-b0d1-67bbb6dfa28b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153745 May 16 17:18:59.260995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 996/2299] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:18:59 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:18:59.293034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:59.302430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:59.303971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:18:59.305145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-34092a12-46c0-4567-97eb-3861e5f3cc27 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.157032 May 16 17:18:59.305709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1304/2300] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:18:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:00.276393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:00.277008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:00.283190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:00.283647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:00.285048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:00.285489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:00.323301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:00.324001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:00.330885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:00.332014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:00.332812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:00.333247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:00.415850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:00.423841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f4a37181-d76b-40f9-8647-84581e52f640 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151349 May 16 17:19:00.424403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 997/2301] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:00 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:00.464562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:00.472671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:00.474190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:00.475353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-76427859-fa3c-4927-9478-c36447027013 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155903 May 16 17:19:00.475923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1305/2302] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:01.441002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:01.442143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:01.450733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:01.451194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:01.451988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:01.452431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:01.494057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:01.494612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:01.501270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:01.501716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:01.502518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:01.502954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:01.583463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:01.591644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce2b78ec-dbe7-4469-a44f-ccea3e02a1d1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.154696 May 16 17:19:01.592205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 998/2303] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:01 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:01.629336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:01.637582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:01.639133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:01.640288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e99b527b-fb34-4ccc-895d-8de76c22de7f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150348 May 16 17:19:01.640848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1306/2304] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:02.609175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:02.609836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:02.616163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:02.616608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:02.617362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:02.617821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:02.659268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:02.659909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:02.666268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:02.666655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:02.667414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:02.667842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:02.748196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:02.756788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7ca0e5e4-a651-45d9-b507-f2dd2caf8c3c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151460 May 16 17:19:02.757357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 999/2305] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:02 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:02.803224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:02.811583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:02.813064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:02.814242 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-98790570-04f2-46c0-9362-567f57e081bd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158939 May 16 17:19:02.814801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1307/2306] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:03.774398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:03.774977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:03.781224 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:03.781672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:03.782468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:03.782901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:03.832324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:03.833439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:03.840035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:03.840475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:03.841228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:03.841655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:03.909477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:03.918901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-67b16b3e-6ee0-4ad9-89bb-fa845c10e0e6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149034 May 16 17:19:03.919485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1000/2307] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:03 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:03.967866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:03.976613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:03.978130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:03.979391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c9027ef7-e978-4a22-9d9d-3b44efbc9c15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150944 May 16 17:19:03.979957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1308/2308] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:03 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:04.936487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:04.937100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:04.943567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:04.944024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:04.944796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:04.945240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:04.997478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:04.998117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:05.004433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:05.004875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:05.005632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:05.006086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:05.074669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:05.083349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8eeb3aaa-89c2-4a47-8caa-e3f213ee0f64 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150474 May 16 17:19:05.083919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1001/2309] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:04 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:05.131730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:05.139818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:05.141296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:05.142481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da41343b-47f0-4590-9574-3b50f933b90e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148928 May 16 17:19:05.143044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1309/2310] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:06.101155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:06.101919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:06.108205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:06.108653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:06.109417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:06.109889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:06.169270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:06.170551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:06.178160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:06.178723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:06.179499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:06.179931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:06.242374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:06.250339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4d9b6732-79e4-4a1a-a6b6-2b6f73c42558 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153644 May 16 17:19:06.251340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1002/2311] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:06 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:06.317949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:06.326404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:06.327905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:06.331004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e276e964-760d-44ab-8163-9754c269a33e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.167447 May 16 17:19:06.332655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1310/2312] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:07.267283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:07.267901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:07.274208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:07.274657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:07.275422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:07.275859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:07.352302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:07.352901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:07.359315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:07.359758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:07.360520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:07.360948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:07.409004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:07.418418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-63b60348-c74e-4872-b7f0-dfd472fc895a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.154995 May 16 17:19:07.419110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1003/2313] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:07 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:07.489535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:07.497638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:07.499145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:07.500328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bf83a3f6-17b9-4a38-a75c-79f065f30472 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152396 May 16 17:19:07.501142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1311/2314] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:08.435525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:08.436287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:08.442741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:08.443197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:08.443978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:08.444419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:08.518797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:08.519438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:08.526327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:08.526776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:08.527539 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:08.527977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:08.571036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:08.578835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-adae405a-5ec0-4512-9a9c-cf1bb5c66b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147229 May 16 17:19:08.579407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1004/2315] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:08 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:08.655476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:08.663792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:08.665257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:08.666481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ab8259bc-1c4c-4028-9511-92e4605258d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151544 May 16 17:19:08.667069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1312/2316] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:09.596678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:09.597289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:09.603651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:09.604096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:09.604855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:09.605289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:09.684409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:09.685027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:09.691308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:09.692571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:09.693349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:09.693807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:09.732926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:09.743955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0b4ef2b6-b679-4f93-a177-67ccf7e9be13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151110 May 16 17:19:09.744567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1005/2317] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:09 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:09.824466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:09.832601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:09.834411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:09.835579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b76e79d-38ba-47b1-a07a-39318f9819d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155039 May 16 17:19:09.836150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1313/2318] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:10.761642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:10.762286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:10.768570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:10.769025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:10.769812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:10.770251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:10.854405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:10.855175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:10.861595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:10.862154 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:10.862916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:10.863383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:10.897145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:10.906750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-baadd684-167a-46d9-a42d-d6dabc61921c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148944 May 16 17:19:10.907405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1006/2319] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:10 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:10.992849 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:11.001003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:11.002547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:11.003709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-99061e41-6661-46b9-8b60-8fe2a994cac3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.153147 May 16 17:19:11.004278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1314/2320] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:11.923214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:11.923829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:11.930728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:11.931186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:11.931958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:11.932397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:12.022229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:12.022952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:12.029525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:12.030006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:12.030762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:12.031191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:12.057413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:12.065222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0320f72a-e261-45ef-8816-b05bd62189ae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145844 May 16 17:19:12.065812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1007/2321] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:12.154749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:12.162828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:12.164323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:12.165487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d1a349e3-734e-404f-acb1-567e032b9181 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147209 May 16 17:19:12.166096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1315/2322] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:13.083197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:13.083822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:13.090446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:13.090902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:13.091677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:13.092115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:13.184326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:13.185034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:13.191459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:13.192513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:13.193335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:13.193858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:13.221398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:13.229406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c1e20c93-84aa-47b1-818f-b9565535b644 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150609 May 16 17:19:13.230234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1008/2323] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:13.320273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:13.328261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:13.329756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:13.330905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0895d46e-40ce-4cab-b31f-b0d1581f87e6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150453 May 16 17:19:13.331494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1316/2324] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:14.246353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:14.246963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:14.253204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:14.253655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:14.254448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:14.254883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:14.351231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:14.352030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:14.358249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:14.358779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:14.359559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:14.359992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:14.382789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:14.390508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3bab1c66-ac29-4b1a-810f-b4253af64841 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148122 May 16 17:19:14.391072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1009/2325] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:14 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:14.492397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:14.500826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:14.502322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:14.503496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7ef1372c-7a94-4df2-a167-6a51185e0cc5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.156750 May 16 17:19:14.504064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1317/2326] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:15.408335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:15.409012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:15.415513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:15.415959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:15.416753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:15.417185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:15.522315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:15.523040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:15.529134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:15.529589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:15.530385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:15.530821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:15.546308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:15.554706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fc0b50b-55a0-4063-a2f5-8cd0aaaa7692 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150441 May 16 17:19:15.555477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1010/2327] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:15 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:15.657377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:15.666507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:15.668008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:15.669178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-adef08a5-3667-487e-bd46-d013f7d0e038 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150844 May 16 17:19:15.669806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1318/2328] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:16.571707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:16.572327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:16.578851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:16.579340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:16.580123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:16.580569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:16.686842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:16.687471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:16.694027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:16.694481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:16.695372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:16.695818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:16.709406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:16.717185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5ef58802-da57-4da3-80db-2a849f529b80 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149366 May 16 17:19:16.717777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1011/2329] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:16 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:16.831489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:16.841493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:16.843183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:16.844585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d401735f-3a99-4dad-ac81-d0c700d8707f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.161611 May 16 17:19:16.845213 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1319/2330] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:17.735055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:17.735681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:17.742723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:17.743179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:17.743954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:17.744397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:17.863037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:17.864265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:17.870380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:17.870752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:17.871214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:17.871983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:17.872604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:17.878114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2867108b-6977-41cc-a886-f39c47a1d097 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147152 May 16 17:19:17.878804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1012/2331] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:17 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:17.996024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:18.004227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:18.005728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:18.006915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2c49b8c2-8981-49b2-ad96-e77692558ae4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147881 May 16 17:19:18.007480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1320/2332] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:18.895093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:18.895750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:18.901997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:18.902446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:18.903207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:18.903637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:19.024513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:19.025127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:19.030793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:19.031399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:19.031905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:19.032606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:19.033038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:19.039106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-712b3923-345f-4652-9a03-4fcfe9d2516b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148016 May 16 17:19:19.039682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1013/2333] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:19.156596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:19.165181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:19.166691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:19.167840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-88492d2c-047d-472b-8385-46628892b243 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147305 May 16 17:19:19.168404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1321/2334] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:20.056086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:20.056839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:20.063669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:20.064237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:20.065005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:20.065436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:20.186600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:20.187192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:20.191041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:20.193885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:20.194331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:20.195091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:20.195521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:20.199275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2e0400db-e543-4ddd-b938-0e4a8922d1a6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147291 May 16 17:19:20.199836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1014/2335] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:20 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:20.323055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:20.331129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:20.332622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:20.333790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-963edeb9-4072-4852-80d0-728e499fff5a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151014 May 16 17:19:20.334615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1322/2336] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:21.216210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:21.216828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:21.223103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:21.224121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:21.224880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:21.225313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:21.352252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:21.352861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:21.354449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:21.359120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:21.359567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:21.360327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:21.360757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:21.362193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-371fa438-f8a5-4469-812e-ffa590bfd8e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149806 May 16 17:19:21.362989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1015/2337] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:21 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:21.484642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:21.492717 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:21.494221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:21.495367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d88baaec-dc74-4702-acdd-a3a075e33b6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.147095 May 16 17:19:21.495928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1323/2338] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:22.379239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:22.379945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:22.386182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:22.386634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:22.387423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:22.387856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:22.515092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:22.515438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:22.516043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:22.522776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:22.523231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:22.523425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f15a8f37-e2d0-4027-bac8-a0b08d6bd354 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148060 May 16 17:19:22.523996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1016/2339] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:22 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:22.524153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:22.524433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:22.654233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:22.662945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:22.664433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:22.665590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eb46cdee-c3c9-4ef4-97e5-e32989548995 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.154077 May 16 17:19:22.666197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1324/2340] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:23.540709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:23.541251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:23.547504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:23.547965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:23.548736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:23.549173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:23.674322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:23.682218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5cffb19c-767d-4020-984b-98e290a8601f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145479 May 16 17:19:23.682786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1017/2341] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:23.683839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:23.684461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:23.690778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:23.691233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:23.692517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:23.692956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:23.826061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:23.835249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:23.836765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:23.837961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-91777f57-74cf-40bb-8518-cd4d58f87c74 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.158055 May 16 17:19:23.838529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1325/2342] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:24.699342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:24.699898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:24.706186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:24.706642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:24.707408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:24.707845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:24.835923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:24.844548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9d967178-61c1-4cf7-8033-fb93cf765c9d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149146 May 16 17:19:24.845150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1018/2343] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:24 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:24.856324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:24.856944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:24.863723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:24.864189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:24.864928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:24.865356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:24.990875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:24.998985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:25.000468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:25.001613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3da828a5-068c-493e-aedb-7b9a230c2dbf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149231 May 16 17:19:25.002214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1326/2344] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:25.862396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:25.863023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:25.870092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:25.870552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:25.871327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:25.871771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:25.995501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:26.003316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8aea6834-cfe3-4ed3-93be-1f49ab2cf03a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144865 May 16 17:19:26.003888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1019/2345] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:25 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:26.020256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:26.020889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:26.027159 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:26.027602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:26.028350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:26.028780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:26.153241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:26.162105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:26.163747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:26.164926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c5d2dc7b-fecb-45be-beeb-8c60f5ef808d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.148534 May 16 17:19:26.165487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1327/2346] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:27.020287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:27.020934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:27.027529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:27.027975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:27.028742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:27.029207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:27.158072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:27.165711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f016940d-4d28-4391-9934-d00f0961e52d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149313 May 16 17:19:27.166299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1020/2347] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:27.183652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:27.184256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:27.190487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:27.190930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:27.191682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:27.192773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:27.319546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:27.327753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:27.329247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:27.330438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d3fc8d3d-312c-4558-9b42-51ee00d64a03 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150699 May 16 17:19:27.331009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1328/2348] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:28.182575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:28.183247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:28.189488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:28.189971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:28.190905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:28.191426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:28.317311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:28.325056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ff3fc8dc-5789-410c-a5b4-57b9e71a338b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146426 May 16 17:19:28.325629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1021/2349] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:28.348636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:28.349254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:28.355514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:28.355965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:28.356826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:28.357265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:28.484735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:28.493563 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:28.495096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:28.496257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fa44cd07-6b41-4f99-8edb-075270b63975 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151721 May 16 17:19:28.496817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1329/2350] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:29.342794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:29.343408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:29.349685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:29.350183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:29.350949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:29.351381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:29.479594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:29.487459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e7addf38-4eb8-4363-abd3-20972c41c5a1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148541 May 16 17:19:29.488029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1022/2351] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:29 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:29.515143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:29.515756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:29.522040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:29.522487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:29.523251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:29.523683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:29.651726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:29.660204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:29.662246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:29.663626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-da55ebe9-f170-4f26-b5e7-88f120fbe91a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152348 May 16 17:19:29.664192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1330/2352] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:30.504332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:30.504947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:30.511294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:30.511749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:30.512517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:30.512953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:30.641542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:30.649796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6729b937-896c-47a7-a16c-2fbb1c5f1bef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149329 May 16 17:19:30.650364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1023/2353] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:30.682500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:30.683130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:30.689331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:30.689812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:30.690559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:30.690987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:30.817975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:30.826223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:30.827771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:30.828930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-db1286f0-3d13-479e-8914-20e871130bff tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150304 May 16 17:19:30.829503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1331/2354] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:31.668384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:31.669067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:31.675437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:31.675893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:31.676768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:31.677236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:31.820548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:31.829266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-95c2d978-212d-40fc-9026-7c3a4321386b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.165143 May 16 17:19:31.829878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1024/2355] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:31 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:31.848358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:31.848971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:31.860495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:31.860951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:31.861727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:31.862196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:31.988471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:31.997677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:31.999185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:32.000338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ec004d2e-76a7-4bfa-ab6b-4c8bd5cea910 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.155984 May 16 17:19:32.000892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1332/2356] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:32.849598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:32.850232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:32.856501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:32.856953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:32.857722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:32.858204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:32.985873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:32.994334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-75aeb0e2-ccb0-48f0-b124-e4f0b39a620e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148644 May 16 17:19:32.994908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1025/2357] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:32 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:33.018359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:33.018973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:33.025097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:33.025547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:33.026337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:33.026769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:33.153050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:33.161193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:33.162722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:33.163885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-814b7bfe-7ae3-4aee-bfdc-c1c07cb3eb46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.149367 May 16 17:19:33.164446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1333/2358] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:34.011770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:34.012352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:34.018677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:34.019125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:34.019890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:34.020325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:34.146925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:34.155257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6bb3077f-30ea-413e-bf26-fbb5528bd971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147432 May 16 17:19:34.155826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1026/2359] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:34 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:34.182114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:34.182716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:34.188934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:34.189376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:34.190157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:34.190587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:34.317326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:34.326181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:34.327743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:34.328893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-77a357fa-cbe7-4966-ae24-ac4c94029c44 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.150661 May 16 17:19:34.329449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1334/2360] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:35.172198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:35.172818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:35.179721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:35.180177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:35.180946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:35.181390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:35.312380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:35.320691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ffe4ad79-6a71-4e7e-8639-33e6c985db39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152391 May 16 17:19:35.321304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1027/2361] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:35 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:35.347090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:35.347698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:35.353892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:35.354335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:35.355080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:35.355507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:35.483689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:35.492383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:35.493915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:35.495069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a8649fff-afb6-4099-b62e-061684d98c3e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151800 May 16 17:19:35.495619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1335/2362] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:36.338462 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:36.339128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:36.345510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:36.345991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:36.346770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:36.347209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:36.472624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:36.480317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-988a1086-2892-4e97-a960-2f98b7ea1de3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146681 May 16 17:19:36.480886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1028/2363] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:36 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:36.513572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:36.514240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:36.520587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:36.521040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:36.521817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:36.522296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:36.650212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:36.658449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:36.659928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:36.661073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-56b7d408-32fb-46c8-896a-c1ac685f35ed tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151342 May 16 17:19:36.661635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1336/2364] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:37.498159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:37.498725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:37.505642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:37.508914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:37.508914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:37.508914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:37.635721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:37.643485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-52810805-582c-4b2e-8d9e-088f90570fb0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149358 May 16 17:19:37.644052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1029/2365] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:37 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:37.681219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:37.681903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:37.688081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:37.688520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:37.689274 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:37.689703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:37.815794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:37.824994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:37.826544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:37.827720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3b20875d-fe47-4c13-b9d7-ba79f602ca37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.152456 May 16 17:19:37.828287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1337/2366] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:38.660700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:38.661311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:38.667753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:38.668150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:38.668913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:38.669346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:38.804727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:38.812636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6f2834aa-e421-49a3-9ac2-1db40b621d6b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.156189 May 16 17:19:38.813205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1030/2367] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:38 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:38.849435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:38.850072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:38.856956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:38.857400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:38.858189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:38.858640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:38.985641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:38.994296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:38.995775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:38.996929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-831cde56-1a43-4740-828e-b1885f8964a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1802 microversion: 2.20 time: 0.151326 May 16 17:19:38.997495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1338/2368] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:39.015786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bd9e44b9-1d55-4e52-a365-f988101deeb6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '.version_select at 0x7feace110670>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:39.036425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bd9e44b9-1d55-4e52-a365-f988101deeb6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221854785" status: 204 len: 0 microversion: 2.20 time: 0.024465 May 16 17:19:39.036992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1031/2369] 10.222.0.70 () {60 vars in 1258 bytes} [Mon May 16 17:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221854785 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:19:39.833147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:39.834040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:39.840683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:39.841133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:39.841936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:39.842371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:39.987111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:39.995590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9336a026-7f6a-4961-8183-a484e839538a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.166294 May 16 17:19:39.996147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1339/2370] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:39 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:40.030617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-459c632f-0b15-4468-8f05-ca1fe17c97b5 req-8a15e41d-306e-43cb-98aa-d6bd4bc90e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:19:40.040276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-459c632f-0b15-4468-8f05-ca1fe17c97b5 req-8a15e41d-306e-43cb-98aa-d6bd4bc90e4e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:40.040810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-459c632f-0b15-4468-8f05-ca1fe17c97b5 req-8a15e41d-306e-43cb-98aa-d6bd4bc90e4e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:40.051280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-459c632f-0b15-4468-8f05-ca1fe17c97b5 req-8a15e41d-306e-43cb-98aa-d6bd4bc90e4e service nova] Creating event network-changed:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 17:19:40.058801 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-459c632f-0b15-4468-8f05-ca1fe17c97b5 req-8a15e41d-306e-43cb-98aa-d6bd4bc90e4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153985 May 16 17:19:40.059505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1032/2371] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:19:40.102635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-16813d30-81d7-4f48-aade-725b1544a57f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'create', calling method: .version_select at 0x7feacd89e700>, body: {"keypair": {"name": "tempest-keypair-792796251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIMqyp/Yi1fbWLgRoln7quti7cOci+Hc1/8ld9OykVUCPmCaTCz1NNG4oHrhcaEQstaRaG9e78Lc0DH+383O8Vgwt/YbV+l7LP4dLMqy2Ub/5Hgpq845ju4r+CxjDVJ/Q=="}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:19:40.122714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-16813d30-81d7-4f48-aade-725b1544a57f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:19:40.127026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-16813d30-81d7-4f48-aade-725b1544a57f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for user 58633f982d3840dd88f631bcee882f5f and project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'key_pairs'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:19:40.155707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-16813d30-81d7-4f48-aade-725b1544a57f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057357 May 16 17:19:40.156705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1340/2372] 10.222.0.70 () {62 vars in 1199 bytes} [Mon May 16 17:19:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 17:19:41.014210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:41.015514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:41.025111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:41.026353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:41.028599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:41.029211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:41.184520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:41.192617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-347de81c-c82f-400c-8b1c-20cfa778714a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.182878 May 16 17:19:41.193182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1033/2373] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:41 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:41.650857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1178956734", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abb8ab83-64bf-4f27-9dbf-594df92bc044"}], "security_groups": [{"name": "tempest-securitygroup--1273058261"}], "key_name": "tempest-keypair-792796251", "user_data": "}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:19:41.750807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] validate_networks() for [('abb8ab83-64bf-4f27-9dbf-594df92bc044', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:19:42.210924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:42.211484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:42.218181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:42.218637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:42.219426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:42.219867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:42.355001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:42.362738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b33fca20-0255-45eb-a632-544907da3d8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.156199 May 16 17:19:42.363620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1034/2374] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:42 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:42.416278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:19:42.416701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:19:42.417178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:19:42.417601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:19:42.418038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:19:42.426562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:42.427005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:42.427793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:42.428223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:42.444005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:19:42.448440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Getting quotas for user 58633f982d3840dd88f631bcee882f5f and project 08b1d6066aaf4e969b8c69cd72d1de4e. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:19:42.459891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:19:42.462809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:19:42.516465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ce2d2ec5-0ad2-4bae-9bee-4d6916413e2c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.871058 May 16 17:19:42.517121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1341/2375] 10.222.0.70 () {62 vars in 1187 bytes} [Mon May 16 17:19:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 17:19:42.527534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5018a67a-40ef-4f07-b819-8e760404e34a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:42.528147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5018a67a-40ef-4f07-b819-8e760404e34a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:42.579556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5018a67a-40ef-4f07-b819-8e760404e34a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:42.586881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5018a67a-40ef-4f07-b819-8e760404e34a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:42.588368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5018a67a-40ef-4f07-b819-8e760404e34a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:42.589460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5018a67a-40ef-4f07-b819-8e760404e34a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1281 microversion: 2.20 time: 0.066387 May 16 17:19:42.590061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1035/2376] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:42 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:43.380201 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:43.380818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:43.388951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:43.389407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:43.390215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:43.390652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:43.522399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:43.530993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5bdcd4af-c9a1-4589-9206-6c9b0c024d3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155167 May 16 17:19:43.531552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1342/2377] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:43 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:43.608154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3e9c0dfb-f631-4132-95ef-bc802d4c460c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:43.608771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3e9c0dfb-f631-4132-95ef-bc802d4c460c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:43.660382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3e9c0dfb-f631-4132-95ef-bc802d4c460c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:43.668223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3e9c0dfb-f631-4132-95ef-bc802d4c460c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:43.669721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3e9c0dfb-f631-4132-95ef-bc802d4c460c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:43.670840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3e9c0dfb-f631-4132-95ef-bc802d4c460c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1281 microversion: 2.20 time: 0.066623 May 16 17:19:43.671386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1036/2378] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:43 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:44.548812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:44.549422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:44.556198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:44.556641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:44.557399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:44.557859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:44.682221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:44.688603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-96f7521c-3469-4018-841f-db0a94f5d195 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:44.689280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-96f7521c-3469-4018-841f-db0a94f5d195 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:44.690352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-efc6cc3e-d247-4779-9a60-92b9fed49bfa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145541 May 16 17:19:44.696898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1343/2379] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:44 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:44.750859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-96f7521c-3469-4018-841f-db0a94f5d195 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:44.758115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-96f7521c-3469-4018-841f-db0a94f5d195 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:44.759734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-96f7521c-3469-4018-841f-db0a94f5d195 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:44.760875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-96f7521c-3469-4018-841f-db0a94f5d195 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1281 microversion: 2.20 time: 0.076399 May 16 17:19:44.761463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1037/2380] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:44 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:45.707715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:45.708494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:45.715980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:45.716435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:45.717196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:45.717637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:45.779238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-851a5fa9-4a17-4f2d-89dc-e0cb22a57c3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:45.779951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-851a5fa9-4a17-4f2d-89dc-e0cb22a57c3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:45.837361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-851a5fa9-4a17-4f2d-89dc-e0cb22a57c3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:45.844290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-851a5fa9-4a17-4f2d-89dc-e0cb22a57c3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:45.845830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-851a5fa9-4a17-4f2d-89dc-e0cb22a57c3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:45.846952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-851a5fa9-4a17-4f2d-89dc-e0cb22a57c3d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1281 microversion: 2.20 time: 0.071815 May 16 17:19:45.847755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1038/2381] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:45 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:45.861056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:45.870048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fbd1b5af-40e6-41f7-8f33-24532b98a177 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.166154 May 16 17:19:45.870631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1344/2382] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:45 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:46.870560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:46.871484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:46.880278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:46.880920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:46.882157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:46.883312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:46.887546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:46.888166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:46.894593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:46.895041 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:46.895812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:46.896249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:46.947352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:46.955234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:46.956700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:46.957901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8429eb22-4ce1-45d3-a730-6beb8b789752 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1285 microversion: 2.20 time: 0.093127 May 16 17:19:46.958472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1039/2383] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:46 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:47.031492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:47.039875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2344faa1-afc1-46c4-932e-2254318d6e62 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155743 May 16 17:19:47.040450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1345/2384] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:46 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:47.977090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:47.977708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:47.984017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:47.984464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:47.985231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:47.985669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:48.058821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:48.059554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:48.060468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:48.066239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:48.066694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:48.067472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:48.067907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:48.068355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:48.069899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:48.071675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d33c7202-c007-4054-90e0-63567c84a381 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1339 microversion: 2.20 time: 0.099636 May 16 17:19:48.072548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1040/2385] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:47 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:48.203783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:48.212350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d6eea0b9-6064-449d-982a-03124b66b8ff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.158090 May 16 17:19:48.212866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1346/2386] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:48 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:49.090674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:49.091298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:49.107904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:49.108363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:49.109163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:49.109610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:49.230145 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:49.232360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:49.240724 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:49.241193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:49.242989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:49.243617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:49.300782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:49.312177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:49.314669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:49.316116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6850e54c-f96b-48d0-9719-82a0bc7279dd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.229943 May 16 17:19:49.316997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1041/2387] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:49 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:49.378970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:49.386804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7a389404-0fe4-4949-b691-498bba62748f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.162310 May 16 17:19:49.387386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1347/2388] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:49 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:49.419003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-a2a14de1-d815-4555-a609-22c5bfb29b14 req-9f90f2cb-bd78-4749-8795-7c945d19e6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50aa4da-9029-4dae-bc88-51d80ddbb215", "tag": "ed53643e-bfe8-4cf9-ada9-27da0c055154"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:19:49.438697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-a2a14de1-d815-4555-a609-22c5bfb29b14 req-9f90f2cb-bd78-4749-8795-7c945d19e6d4 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:49.439155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-a2a14de1-d815-4555-a609-22c5bfb29b14 req-9f90f2cb-bd78-4749-8795-7c945d19e6d4 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:49.452176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-a2a14de1-d815-4555-a609-22c5bfb29b14 req-9f90f2cb-bd78-4749-8795-7c945d19e6d4 service nova] Creating event network-changed:ed53643e-bfe8-4cf9-ada9-27da0c055154 for instance a50aa4da-9029-4dae-bc88-51d80ddbb215 on hv-cinder-83998 May 16 17:19:49.467705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-a2a14de1-d815-4555-a609-22c5bfb29b14 req-9f90f2cb-bd78-4749-8795-7c945d19e6d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059700 May 16 17:19:49.468744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1042/2389] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:19:50.335704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:50.336349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:50.342633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:50.343083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:50.343831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:50.344261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:50.461507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:50.462429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:50.468452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:50.469568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:50.470141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:50.470924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:50.471363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:50.476098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:50.478268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:50.479564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-985e1233-9e64-4e49-bba6-e7f58e7acf43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.148214 May 16 17:19:50.480128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1348/2390] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:50 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:50.606508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:50.614566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e3709472-d392-43fd-b2e1-ad904ffd426b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.158094 May 16 17:19:50.615122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1043/2391] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:50 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:51.497058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:51.497672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:51.504087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:51.504535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:51.505296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:51.505798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:51.630781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:51.632507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:51.633767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:51.639268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:51.640042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:51.640499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:51.640761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:51.641271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:51.641709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:51.641893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7f8fa62c-60f6-4350-b3bd-c946574f663a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.148762 May 16 17:19:51.642462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1349/2392] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:51 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:51.767317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:51.775760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-38b066cb-0de1-40e1-96ae-1d07f5dbd087 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147267 May 16 17:19:51.776513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1044/2393] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:51 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:52.658957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:52.659628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:52.666652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:52.667049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:52.667807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:52.668248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:52.796456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:52.796973 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:52.797114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:52.803504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:52.803969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:52.804761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:52.804881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:52.805268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:52.806508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:52.807671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b12cbfb1-9a63-45cf-8270-bd3436c51d56 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.152624 May 16 17:19:52.808239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1350/2394] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:52 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:52.946655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:52.954283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-459faa6d-2327-48dc-a548-5e048c40db6a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.161851 May 16 17:19:52.954851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1045/2395] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:52 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:53.828512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:53.829071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:53.836181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:53.836630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:53.837393 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:53.837853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:53.963615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:53.971799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:53.972005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:53.972480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:53.973304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:53.974463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-01cdea85-26a9-44df-a962-dc611ba25328 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.150018 May 16 17:19:53.975246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1351/2396] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:53 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:53.979750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:53.980212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:53.980994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:53.981886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:54.106162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:54.113951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f9403d4-5686-4b41-947c-001a980b1ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145930 May 16 17:19:54.114525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1046/2397] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:53 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:54.993552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:54.994257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:55.000495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:55.000938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:55.001694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:55.002149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:55.131370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:55.131998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:55.132606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:55.138473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:55.138933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:55.139727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:55.140165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:55.141161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:55.142692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:55.143798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1d4651fa-5185-4973-a594-19546c4e5e9f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.154716 May 16 17:19:55.144373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1352/2398] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:54 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:55.270467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:55.278844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-47ddadf6-03f9-4811-848f-a2890eb01f4a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151712 May 16 17:19:55.279415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1047/2399] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:55 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:55.533413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-a784492d-834d-4568-a7cf-a1e5e8870716 req-7029a586-13e6-4943-9aec-a89498159f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50aa4da-9029-4dae-bc88-51d80ddbb215", "name": "network-vif-plugged", "status": "completed", "tag": "ed53643e-bfe8-4cf9-ada9-27da0c055154"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:19:55.541968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a784492d-834d-4568-a7cf-a1e5e8870716 req-7029a586-13e6-4943-9aec-a89498159f77 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:55.542406 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a784492d-834d-4568-a7cf-a1e5e8870716 req-7029a586-13e6-4943-9aec-a89498159f77 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:55.552974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-a784492d-834d-4568-a7cf-a1e5e8870716 req-7029a586-13e6-4943-9aec-a89498159f77 service nova] Creating event network-vif-plugged:ed53643e-bfe8-4cf9-ada9-27da0c055154 for instance a50aa4da-9029-4dae-bc88-51d80ddbb215 on hv-cinder-83998 May 16 17:19:55.558273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-a784492d-834d-4568-a7cf-a1e5e8870716 req-7029a586-13e6-4943-9aec-a89498159f77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086076 May 16 17:19:55.558873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1353/2400] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:19:56.163546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:56.164166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:56.170642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:56.171094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:56.171860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:56.172323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:56.297153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:56.297861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:56.300383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:56.303899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:56.304857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:56.305609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:56.306064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:56.308781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:56.310342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:56.311461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5a6f5ca3-f2c8-4348-be1b-f93f1e4a4c8c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1407 microversion: 2.20 time: 0.151869 May 16 17:19:56.312034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1048/2401] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:56 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:19:56.432099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:56.439866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ac4f2886-0736-4c47-83f0-e1dd3dc4f946 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147339 May 16 17:19:56.440435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1354/2402] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:56 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:57.329490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:57.330136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:57.339228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:57.339690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:57.340475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:57.340917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:57.456325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:57.457069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:57.464249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:57.464703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:57.465477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:57.465946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:57.470120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:57.478100 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:57.479672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:57.480753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8d03d092-6c08-4689-95bb-c450cce16aee tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1600 microversion: 2.20 time: 0.155197 May 16 17:19:57.481309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1049/2403] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:19:57 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:19:57.497794 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:57.498299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:57.504688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:57.505146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:57.505959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:57.506407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:57.583750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b634afc4-0c1e-410b-926d-e71e7a503c01 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088907 May 16 17:19:57.590239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1050/2404] 10.222.0.70 () {60 vars in 1315 bytes} [Mon May 16 17:19:57 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:19:57.603673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:57.612221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f138e301-128a-4a32-b2b9-6aa9b4b26f9e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.159700 May 16 17:19:57.612796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1355/2405] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:57 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:58.487295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-a8cc7e6d-6b1d-4ef9-b95f-0907b64ccbed req-aa48e860-eead-4b8d-816d-0ea32fa41012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50aa4da-9029-4dae-bc88-51d80ddbb215", "tag": "ed53643e-bfe8-4cf9-ada9-27da0c055154"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:19:58.495416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-a8cc7e6d-6b1d-4ef9-b95f-0907b64ccbed req-aa48e860-eead-4b8d-816d-0ea32fa41012 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:58.495872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-a8cc7e6d-6b1d-4ef9-b95f-0907b64ccbed req-aa48e860-eead-4b8d-816d-0ea32fa41012 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:58.507194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-a8cc7e6d-6b1d-4ef9-b95f-0907b64ccbed req-aa48e860-eead-4b8d-816d-0ea32fa41012 service nova] Creating event network-changed:ed53643e-bfe8-4cf9-ada9-27da0c055154 for instance a50aa4da-9029-4dae-bc88-51d80ddbb215 on hv-cinder-83998 May 16 17:19:58.512371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-a8cc7e6d-6b1d-4ef9-b95f-0907b64ccbed req-aa48e860-eead-4b8d-816d-0ea32fa41012 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029266 May 16 17:19:58.513041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1051/2406] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:19:58.544606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:19:58.544830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:19:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:19:58.630246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:58.630879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:58.638278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:58.638730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:58.639512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:58.639986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:58.841045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:58.851125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e0184bcc-c456-4a39-a3f6-6c3f2f968b66 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.224941 May 16 17:19:58.861821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1356/2407] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:58 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:19:59.229782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:59.230704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:59.236970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:59.237598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:59.238466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:59.239092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:59.266370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:19:59.354096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f36b864e-3cab-42cf-b9bf-a3bc55f6b97c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 204 len: 0 microversion: 2.1 time: 0.130505 May 16 17:19:59.355074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1052/2408] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:19:59 2022] DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:19:59.364927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:59.366022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:59.373714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:59.374295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:59.375179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:59.375703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:59.519603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:19:59.528856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-875c367f-00bf-4098-a35b-963f299d7987 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1721 microversion: 2.1 time: 0.169703 May 16 17:19:59.529441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1357/2409] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:19:59.869134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:19:59.869880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:19:59.876366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:59.876819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:19:59.877758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:19:59.878215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:00.008298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:00.015978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5547dbba-ce61-45f9-8780-d8eea47df9b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151155 May 16 17:20:00.016535 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1053/2410] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:19:59 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:00.546608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:00.547267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:00.553756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:00.554163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:00.555447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:00.555920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:00.685980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:00.693748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-02415722-f6f0-4a6c-972e-f0dd79dd1772 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1721 microversion: 2.1 time: 0.151269 May 16 17:20:00.694335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1358/2411] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:01.032568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:01.033180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:01.040116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:01.040654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:01.041420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:01.041892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:01.173234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:01.182194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-76208c7a-c2bf-4644-bbae-b71e059b2da1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153243 May 16 17:20:01.182514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1054/2412] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:01 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:01.711951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:01.712618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:01.719264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:01.719716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:01.720488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:01.720923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:01.796193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:01.805367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8b62c840-8e11-443b-90d9-2c634136dfba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1654 microversion: 2.1 time: 0.097582 May 16 17:20:01.806163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1359/2413] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:01.840013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-1458ad90-6461-4d41-9fef-5f625acb0583 req-28994e6a-9f5f-4d61-94ad-40736ea0b077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb86dab5-8d6b-4d24-969a-687c2224d48d", "name": "network-vif-deleted", "tag": "0d2d13e9-d075-4dd0-a707-5f7669545169"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:20:01.848539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-1458ad90-6461-4d41-9fef-5f625acb0583 req-28994e6a-9f5f-4d61-94ad-40736ea0b077 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:01.848995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-1458ad90-6461-4d41-9fef-5f625acb0583 req-28994e6a-9f5f-4d61-94ad-40736ea0b077 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:01.861495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-1458ad90-6461-4d41-9fef-5f625acb0583 req-28994e6a-9f5f-4d61-94ad-40736ea0b077 service nova] Creating event network-vif-deleted:0d2d13e9-d075-4dd0-a707-5f7669545169 for instance bb86dab5-8d6b-4d24-969a-687c2224d48d on hv-cinder-83998 May 16 17:20:01.866453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-1458ad90-6461-4d41-9fef-5f625acb0583 req-28994e6a-9f5f-4d61-94ad-40736ea0b077 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128933 May 16 17:20:01.872101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1055/2414] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:20:02.198198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:02.198840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:02.204763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:02.205212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:02.205995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:02.206432 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:02.336092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:02.343759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5430ce4d-5785-4869-b693-daec8f6bacae tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149434 May 16 17:20:02.344338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1360/2415] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:02 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:02.824885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:02.825590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:02.831707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:02.832156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:02.832917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:02.833637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:02.893568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:02.901325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8616c81e-5cad-4ecb-afb1-a5ccceb3cdab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081793 May 16 17:20:02.901910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1056/2416] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:03.360591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:03.361125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:03.368085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:03.368538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:03.369294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:03.369727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:03.498800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:03.506456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d420e3e-cb06-4cb6-92c1-8e2538ef0ac8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149867 May 16 17:20:03.507030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1361/2417] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:03 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:03.917901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:03.918529 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:03.924804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:03.925257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:03.926056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:03.926496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:03.992690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:04.000367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-56950ca5-65d2-4de1-ae99-4f2a1a4841a7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086424 May 16 17:20:04.000936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1057/2418] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:04.523219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:04.523834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:04.530139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:04.530589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:04.531348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:04.531781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:04.660548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:04.668902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-21a8568b-5e28-4524-9464-eb8e3942f51a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149482 May 16 17:20:04.669644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1362/2419] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:04 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:05.017728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:05.018311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:05.025313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:05.025786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:05.026554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:05.027240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:05.088505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:05.096200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-adbfea8c-63e4-4ff0-b978-bdfa0522dcf9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082387 May 16 17:20:05.096765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1058/2420] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:05.685004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:05.685553 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:05.691816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:05.692262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:05.693014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:05.693440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:05.817046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:05.825822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-61114709-fa3d-4888-8043-c758046a7d08 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144567 May 16 17:20:05.826477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1363/2421] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:05 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:06.113823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:06.114524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:06.120776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:06.121223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:06.122007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:06.122442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:06.184779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:06.192450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fd403ee-324e-4f0e-985f-9c356ebc4cf3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082529 May 16 17:20:06.193006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1059/2422] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:06.844272 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:06.844943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:06.851562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:06.852007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:06.852760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:06.853189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:06.982046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:06.989648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c67d49b8-cc56-4978-bef8-17a49a5264b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149383 May 16 17:20:06.990240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1364/2423] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:06 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:07.211108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:07.211690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:07.217982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:07.218438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:07.219204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:07.219642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:07.282796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:07.291114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7bb9a0ec-6a70-4d48-893b-fbb4dcbea372 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084202 May 16 17:20:07.291679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1060/2424] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:08.006550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:08.007160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:08.014134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:08.014585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:08.015344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:08.015779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:08.140073 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:08.147768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8348b257-8c71-48c1-a22a-20e42c50b09a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145061 May 16 17:20:08.148339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1365/2425] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:08 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:08.308349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:08.309031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:08.315700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:08.316151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:08.316917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:08.317355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:08.378983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:08.387294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0d83c2c2-f1a6-479f-a648-216bd1a4ee99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083595 May 16 17:20:08.387868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1061/2426] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:09.164803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:09.165419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:09.171771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:09.172209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:09.172962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:09.173390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:09.312940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:09.321312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ba05a138-97b7-4fa9-826e-c03b84861cf6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.160334 May 16 17:20:09.321914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1366/2427] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:09 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:09.405669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:09.406316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:09.412909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:09.413371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:09.414184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:09.414625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:09.478379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:09.488110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-90f97336-8df8-4c7d-884b-ec0d185cba12 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086905 May 16 17:20:09.489403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1062/2428] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:10.338751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:10.339363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:10.345582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:10.346059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:10.346820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:10.347253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:10.475478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:10.483872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-99e5f88a-052e-447c-9e97-6ea3a8ee75e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149857 May 16 17:20:10.484442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1367/2429] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:10 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:10.506199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:10.506845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:10.513284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:10.513759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:10.514558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:10.514997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:10.577866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:10.586552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ab08efe0-d92c-4d39-8d74-055576b309f1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084241 May 16 17:20:10.587121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1063/2430] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:11.500821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:11.501386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:11.507887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:11.508371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:11.509152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:11.509583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:11.604059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:11.605025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:11.610835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:11.611320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:11.612098 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:11.612539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:11.666457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:11.675123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-09f1aac6-b5e3-4e4b-99df-eaf74c1ee72d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.177763 May 16 17:20:11.675241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:11.675376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1368/2431] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:11.683761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9250a2f3-764b-4176-974d-6c061c48d44d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084178 May 16 17:20:11.684493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1064/2432] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:12.692556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:12.693109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:12.699516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:12.699972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:12.700201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:12.700743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:12.700881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:12.701179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:12.706986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:12.707432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:12.708445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:12.708886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:12.769686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:12.777956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-83f33629-8068-442d-becb-1620fe820caf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081463 May 16 17:20:12.778526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1065/2433] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:12.831790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:12.840194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83641321-cf49-4254-859f-0846a9e01863 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151631 May 16 17:20:12.840759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1369/2434] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:12 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:13.795310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:13.795922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:13.802253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:13.802702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:13.803461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:13.803895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:13.856867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:13.857589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:13.863874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:13.864257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:13.864711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:13.865474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:13.865941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:13.872244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1589e73d-b0d3-446f-a71d-819913569dd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080827 May 16 17:20:13.872809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1066/2435] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:13.996606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:14.004323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7b8a0688-fb2f-4021-8c49-5e178ca6a6c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151302 May 16 17:20:14.004894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1370/2436] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:14.889062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:14.889676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:14.895995 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:14.896444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:14.897228 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:14.898190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:14.962536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:14.970106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-97ef5015-2cd7-46eb-8677-77c890cf2d3d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084947 May 16 17:20:14.970662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1067/2437] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:15.021835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:15.022455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:15.028942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:15.029391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:15.030189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:15.030627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:15.159031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:15.166888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ea79e142-5e43-4aaa-84c6-9badac3523ec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149087 May 16 17:20:15.167457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1371/2438] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:15 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:15.987836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:15.988453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:15.995681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:15.996133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:15.996898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:15.997334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:16.058393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:16.066134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-83fff686-adb3-44c0-a247-411b49e8667b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082165 May 16 17:20:16.066697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1068/2439] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:16.184391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:16.185038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:16.191287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:16.191732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:16.192495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:16.192927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:16.317349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:16.325019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f77c2adb-02dc-486c-9642-0898676c357a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144439 May 16 17:20:16.325604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1372/2440] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:16 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:17.083805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:17.084420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:17.091173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:17.091633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:17.092400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:17.092839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:17.152612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:17.160351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d3a7060c-079c-4445-a109-febd10f22698 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080714 May 16 17:20:17.160912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1069/2441] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:17.342144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:17.342694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:17.348875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:17.349319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:17.350098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:17.350524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:17.480400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:17.488075 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f791813f-256b-4732-b1df-c4ee261c3173 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149820 May 16 17:20:17.488646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1373/2442] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:17 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:18.177357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:18.177997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:18.184972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:18.185429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:18.186232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:18.186675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:18.246344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:18.254094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-42dea6eb-6271-4977-961b-ff96c2fed445 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080629 May 16 17:20:18.254670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1070/2443] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:18.504520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:18.505059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:18.512351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:18.512804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:18.513572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:18.514045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:18.651742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:18.660077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b8e75b47-9143-4ffc-8bdc-5b96cc5f555e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.159557 May 16 17:20:18.660661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1374/2444] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:19.271610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:19.272247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:19.279124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:19.279577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:19.280344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:19.280781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:19.343051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:19.351437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4a153f3d-05a5-4cb9-b50c-cc93ad13e12d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083101 May 16 17:20:19.352010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1071/2445] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:19.677271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:19.677969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:19.684384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:19.684839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:19.685608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:19.686083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:19.811606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:19.819311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d63fc2d7-bc5e-41d7-8dca-cc9872550636 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145966 May 16 17:20:19.820438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1375/2446] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:19 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:20.368191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:20.368812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:20.375178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:20.375635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:20.376405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:20.376847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:20.436428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:20.444266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-70d96f69-3280-4a19-9c25-7cb89ac28579 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079964 May 16 17:20:20.445364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1072/2447] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:20.837018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:20.837640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:20.843910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:20.844414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:20.845183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:20.845615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:20.983923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:20.998224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-70d289b9-5c7b-4ca5-a1d9-abab7fd6a1fd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.165497 May 16 17:20:20.998806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1376/2448] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:20 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:21.462510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:21.463133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:21.469422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:21.469912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:21.470684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:21.471123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:21.533644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:21.541549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5dbbb4fb-e629-4f32-acc1-edcf357c9b64 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083857 May 16 17:20:21.542138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1073/2449] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:22.016101 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:22.016708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:22.022951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:22.023392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:22.024141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:22.024570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:22.154228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:22.161917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1af21ae0-bec9-4348-966d-226ef2870129 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149662 May 16 17:20:22.162489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1377/2450] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:22 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:22.558334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:22.559065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:22.565438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:22.565937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:22.566706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:22.567146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:22.628744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:22.637057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-819eebfd-3a13-400f-82b4-5bda178a7ca3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082627 May 16 17:20:22.637625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1074/2451] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:23.178382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:23.179513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:23.185726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:23.186195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:23.186946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:23.187381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:23.314842 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:23.323115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-72be381e-5d66-4ecd-a2f8-a58e1b558c5c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148603 May 16 17:20:23.323675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1378/2452] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:23.654508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:23.655241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:23.662222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:23.662675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:23.663491 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:23.663928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:23.726608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:23.734243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0c7d09fa-d5a7-43da-a517-3c52bbeea016 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083651 May 16 17:20:23.734819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1075/2453] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:24.340342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:24.340983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:24.347327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:24.347781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:24.348544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:24.348979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:24.480923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:24.489279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e1fa67d5-3948-4a45-9d97-ed6d3cb13450 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152765 May 16 17:20:24.489897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1379/2454] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:24 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:24.751313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:24.751876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:24.758205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:24.758664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:24.759454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:24.759875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:24.819087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:24.826761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8d923685-2a88-4dde-9600-5399e30763fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079409 May 16 17:20:24.827336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1076/2455] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:25.507021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:25.507653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:25.514288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:25.514738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:25.515499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:25.515933 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:25.647317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:25.655116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e7821232-7d03-4526-9ae2-07adb92ccae2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152204 May 16 17:20:25.655678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1380/2456] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:25 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:25.844324 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:25.844940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:25.851766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:25.852220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:25.852979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:25.853420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:25.912144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:25.920280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-549af54a-d956-44cf-b50c-f63d1b95a27a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079807 May 16 17:20:25.920847 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1077/2457] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:26.672681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:26.673236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:26.680136 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:26.680586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:26.681343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:26.681799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:26.808852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:26.816669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9cbdcc8a-4214-4839-b8de-29ef3a35befd tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148071 May 16 17:20:26.817245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1381/2458] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:26 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:26.939708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:26.940600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:26.949297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:26.949760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:26.950590 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:26.951028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:27.012403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:27.020010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9b7605ab-aad4-4aac-bc14-28582f42a638 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086559 May 16 17:20:27.020570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1078/2459] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:27.833964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:27.834567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:27.840968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:27.841442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:27.842225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:27.842662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:27.965949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:27.973545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-65a43f12-767d-48bc-b70f-a84fb64a4ac7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.143746 May 16 17:20:27.974151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1382/2460] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:28.036276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:28.036926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:28.045041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:28.045490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:28.046289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:28.046728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:28.110070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:28.118317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d79a1f32-8478-47ed-91c5-097da906c781 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085928 May 16 17:20:28.118879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1079/2461] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:28.991004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:28.992311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:28.998559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:28.999007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:28.999760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:29.000194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:29.127484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:29.135395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:29.135987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41836124-76fb-4c32-b4be-31a9fd4dc90d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148793 May 16 17:20:29.136107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:29.136567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1383/2462] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:29.142292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:29.142744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:29.143546 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:29.143985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:29.205402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:29.213279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e8c84e15-fd8e-497a-a2f0-8f13ae73484e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082227 May 16 17:20:29.213868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1080/2463] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:30.152066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:30.152682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:30.159002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:30.159450 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:30.160209 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:30.160646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:30.230014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:30.230633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:30.236881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:30.237308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:30.238108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:30.238550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:30.286174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:30.294662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-20f8286f-276e-4044-af87-1256509c88fb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146459 May 16 17:20:30.295550 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1384/2464] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:30.300185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:30.310718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-77bb5d57-a79c-4bd2-bb9e-c0c2335f7ed1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085120 May 16 17:20:30.311599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1081/2465] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:31.312332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:31.312945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:31.319492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:31.319938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:31.320702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:31.321138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:31.327542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:31.328174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:31.335551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:31.335951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:31.336731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:31.337173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:31.403192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:31.411798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0a6fc195-5653-4e56-8b49-cef3901579ac tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088130 May 16 17:20:31.412385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1082/2466] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:31.464749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:31.472567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2f9c3d26-37dc-4343-a889-e6fc8ddfedec tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.164051 May 16 17:20:31.473156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1385/2467] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:31 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:32.431244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:32.432704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:32.438618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:32.439070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:32.439845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:32.440283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:32.490671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:32.491918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:32.498262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:32.498712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:32.499480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:32.499914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:32.505123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:32.514391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cd2971dd-0895-4cff-9742-4e22c0505eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087796 May 16 17:20:32.514975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1083/2468] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:32.630079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:32.638292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ad9812c1-920e-46c4-b8ab-9be4c4518f3b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151449 May 16 17:20:32.638901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1386/2469] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:32 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:33.533439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:33.534787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:33.544969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:33.545607 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:33.546763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:33.547393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:33.655857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:33.656470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:33.663863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:33.664301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:33.665127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:33.665499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:33.815079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:33.824332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-184facab-bdf7-423d-b8f8-38c71dc5fa33 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.172289 May 16 17:20:33.824924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1387/2470] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:33 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:33.880717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:33.890498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-de4fad87-a992-4f2a-8f63-57daa799ece1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.362476 May 16 17:20:33.891315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1084/2471] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:34.790208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:34.790756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:34.796926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:34.797377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:34.798189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:34.798640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:34.821375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-82c4c903-928e-48dd-b789-68878f14e832 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215/ips" status: 200 len: 152 microversion: 2.20 time: 0.035696 May 16 17:20:34.821984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1388/2472] 10.222.0.70 () {60 vars in 1288 bytes} [Mon May 16 17:20:34 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:20:34.841758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:34.842385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:34.848764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:34.849215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:34.850021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:34.850974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:34.909597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:34.910339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:34.916979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:34.917428 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:34.918234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:34.918672 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:34.982109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:34.983588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:34.990562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fa350475-eb31-4bb9-964d-20e6839736a3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152593 May 16 17:20:34.991749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1085/2473] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:34 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:34.992912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-390e9e1a-59d8-4529-9f3c-626f3e27529a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087090 May 16 17:20:34.993494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1389/2474] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:34 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:36.008517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:36.009152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:36.009725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:36.010370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:36.016680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:36.016897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:36.017128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:36.017292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:36.018134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:36.018255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:36.018363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:36.018447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:36.089607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:36.098610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-79a23d5f-e629-44dd-ace9-1ec24aa2d8e1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.092911 May 16 17:20:36.099197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1390/2475] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:36.162390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:36.172822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cdcd32bc-bbe3-44ef-afca-a167110e1e2c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.168067 May 16 17:20:36.173485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1086/2476] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:36 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:37.118336 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:37.118997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:37.125263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:37.125702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:37.126494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:37.126918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:37.190088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:37.192749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:37.193367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:37.198659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-462d7815-a45e-46e3-8102-177b71d95b3b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085177 May 16 17:20:37.199248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1391/2477] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:37.200339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:37.200770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:37.201553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:37.202013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:37.329653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:37.337671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-852a1610-5e9e-4183-8b82-a5240c774a91 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148792 May 16 17:20:37.338274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1087/2478] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:37 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:38.216004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:38.216644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:38.222992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:38.223442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:38.224200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:38.224633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:38.284705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:38.292446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1c9949ac-0eff-4f20-8d46-ab55183d7f1e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080338 May 16 17:20:38.293008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1392/2479] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:38.354669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:38.355278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:38.362206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:38.362675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:38.363473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:38.364055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:38.500049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:38.509569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9fa4c6bf-1d34-4a9a-9739-b8b6fd8c0ae6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.158702 May 16 17:20:38.510317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1088/2480] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:38 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:39.310099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:39.310702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:39.316941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:39.317389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:39.318166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:39.318596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:39.386876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:39.394610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7d682bc5-f7c2-4bea-a6b0-e43c269ef785 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088390 May 16 17:20:39.395178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1393/2481] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:39.528761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:39.529305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:39.535659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:39.536108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:39.536890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:39.537325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:39.665587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:39.674575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a05e9b53-0ec2-4fd7-9d1d-98619bdbfda2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150533 May 16 17:20:39.675241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1089/2482] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:39 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:40.411694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:40.412181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:40.418514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:40.418965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:40.419733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:40.420165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:40.483127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:40.494905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-05b76d76-b1ec-4083-9baa-c08b1bd49374 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087219 May 16 17:20:40.495666 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1394/2483] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:40.765032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:40.766128 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:40.772309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:40.772755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:40.773519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:40.773975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:40.915605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:40.923666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-74a026e5-28a8-45d2-8606-d5f6b6d52ef1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.235054 May 16 17:20:40.924240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1090/2484] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:40 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:41.513765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:41.514319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:41.520567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:41.521013 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:41.521794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:41.522234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:41.584616 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:41.593236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bc2c3941-c6f1-4e81-89d9-2405ced91b0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083358 May 16 17:20:41.593867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1395/2485] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:41 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:41.941211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:41.941834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:41.949043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:41.949494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:41.950294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:41.950729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:42.087000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:42.095800 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6cc1791a-ae59-489c-a41b-23343960dde3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.158410 May 16 17:20:42.096463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1091/2486] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:41 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:42.612515 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:42.613126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:42.619909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:42.620362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:42.621134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:42.621566 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:42.681852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:42.689806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-44eaebda-3456-4ea1-a752-e0ba368dff0d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081187 May 16 17:20:42.690377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1396/2487] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:43.114112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:43.114741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:43.121068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:43.121516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:43.122306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:43.122738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:43.252241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:43.260611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3dd58aab-1493-4b3b-b0be-ca565dec342a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150396 May 16 17:20:43.261190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1092/2488] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:43 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:43.707511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:43.708319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:43.714533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:43.714974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:43.715720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:43.716149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:43.779265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:43.787094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7fe0bc56-0344-49ed-832b-fb5edb8dd82d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083549 May 16 17:20:43.788291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1397/2489] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:44.277082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:44.277675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:44.284083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:44.284517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:44.285280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:44.285718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:44.415752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:44.423526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-95c0b0b7-2d63-4a95-8d56-54f68505e81e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150326 May 16 17:20:44.424095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1093/2490] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:44 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:44.806247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:44.806878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:44.812670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:44.813112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:44.813897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:44.814317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:44.875671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:44.884221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cab8c8c8-ff29-4fa6-a2cb-f08d11e8ba66 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082458 May 16 17:20:44.884787 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1398/2491] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:45.440597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:45.441209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:45.447459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:45.447905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:45.448658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:45.449087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:45.574665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:45.582551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-77814fd4-b4bf-4758-b702-4d6df80ef82b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145911 May 16 17:20:45.583518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1094/2492] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:45 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:45.901325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:45.901995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:45.908283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:45.908753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:45.909506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:45.909966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:45.970548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:45.978831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3c23183b-c839-4aeb-9285-403b8f11c449 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082198 May 16 17:20:45.979404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1399/2493] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:46.601077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:46.601700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:46.608004 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:46.608455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:46.609215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:46.609652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:46.735240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:46.743728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-894cb3e6-df53-49ef-9bfa-93a959fd5e3e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147134 May 16 17:20:46.744293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1095/2494] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:46 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:46.996191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:46.996884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:47.002988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:47.003433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:47.004185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:47.004617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:47.065887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:47.073690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7d6bbc3e-5078-4fdf-8e57-264398349aff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081399 May 16 17:20:47.074278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1400/2495] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:47.761328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:47.762007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:47.768348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:47.768805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:47.769569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:47.770026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:47.903073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:47.910865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d95fec6c-7521-43e7-ae00-1813a3d26c04 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153476 May 16 17:20:47.911436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1096/2496] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:47 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:48.089661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:48.090296 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:48.096561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:48.097006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:48.097792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:48.098228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:48.164480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:48.172202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f543fd23-80c4-4c62-b917-e5f703a45235 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086358 May 16 17:20:48.172776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1401/2497] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:48.930080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:48.930683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:48.937262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:48.944007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:48.944007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:48.944007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:49.068914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:49.076690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-60038592-560d-4d53-94fa-36471b7c457b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152238 May 16 17:20:49.077263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1097/2498] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:48 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:49.189669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:49.190255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:49.196479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:49.196922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:49.197682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:49.198140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:49.279405 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:49.287235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-af026022-a681-40c6-bcaa-498e4691a5d0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.101526 May 16 17:20:49.288442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1402/2499] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:50.094540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:50.095171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:50.103396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:50.103998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:50.105169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:50.105623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:50.235360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:50.243623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-feea78ad-4d50-4146-bfee-3fe9565fe2f4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152903 May 16 17:20:50.244192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1098/2500] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:50 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:50.305036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:50.305671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:50.311927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:50.312368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:50.313119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:50.313552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:50.375557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:50.383836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d27a79f-d295-47e5-b7ca-58c5efa79898 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083146 May 16 17:20:50.384407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1403/2501] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:51.260753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:51.261380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:51.267906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:51.268365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:51.269142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:51.269585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:51.398365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:51.400449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:51.401107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:51.406745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fb1d0c6a-1056-42d0-82f3-320e8bfe046a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149825 May 16 17:20:51.407528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1099/2502] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:51 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:51.407661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:51.407938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:51.408726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:51.409172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:51.476756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:51.484803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ee450ec8-cffc-43f6-baff-4f61e4cd2b74 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088174 May 16 17:20:51.485390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1404/2503] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:52.424468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:52.425087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:52.431543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:52.432000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:52.432771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:52.433213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:52.502512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:52.504222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:52.511109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:52.511494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:52.512375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:52.512782 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:52.567573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:52.575692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-005e1488-f07d-4b4f-9bd2-e65463b0b69e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155066 May 16 17:20:52.576284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1100/2504] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:52 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:52.582184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:52.590906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b8ea3598-1b7a-48d9-9863-5dede27c760c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.092212 May 16 17:20:52.591519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1405/2505] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:53.594950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:53.595592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:53.602524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:53.602973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:53.603747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:53.604176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:53.608353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:53.608977 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:53.615307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:53.615759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:53.617116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:53.617557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:53.678709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:53.686700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3e98878b-8c91-4253-998b-c6daba01da01 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082156 May 16 17:20:53.687362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1406/2506] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:53.733511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:53.742018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1837e16a-fe1c-4178-b31a-f7791f67e2bf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151842 May 16 17:20:53.742592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1101/2507] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:53 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:54.704359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:54.704942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:54.711357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:54.711801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:54.712548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:54.712979 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:54.759567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:54.760169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:54.766468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:54.766917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:54.767681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:54.768112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:54.775439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:54.783134 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c7a32e51-e5ca-47f1-ac8b-0323b4fbeb7f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082720 May 16 17:20:54.783705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1407/2508] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:54.892861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:54.901183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-70b98995-1f0d-407f-bd12-49722f9d9cc5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146177 May 16 17:20:54.901763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1102/2509] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:54 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:55.799879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:55.800504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:55.807363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:55.807809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:55.808564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:55.809000 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:55.868729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:55.882034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eae65ff4-6402-4456-bb6e-a1b7481c8447 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085919 May 16 17:20:55.882591 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1408/2510] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:55.918250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:55.918868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:55.925146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:55.925602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:55.926408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:55.926855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:56.054824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:56.063099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6bcce6db-7cbb-425c-9684-8b401367a4ed tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148778 May 16 17:20:56.063662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1103/2511] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:55 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:56.901230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:56.902063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:56.908518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:56.908962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:56.909710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:56.910165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:56.973001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:56.980760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8821c290-9b6e-4ee1-bd3b-c0606cf13f5b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084419 May 16 17:20:56.981346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1409/2512] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:20:57.080601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:57.081219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:57.088476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:57.088926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:57.089684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:57.090147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:57.214050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:57.222053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-badb12a4-2a69-403e-86c0-f26c4b8e585a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145127 May 16 17:20:57.222572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1104/2513] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:57 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:57.997701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:57.998457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:58.004860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:58.005371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:58.006251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:58.006751 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:58.067931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:58.076407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-49f1e390-01d8-41b4-acf1-75328d8ffc29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082534 May 16 17:20:58.076987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1410/2514] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:58.239220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:58.239844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:58.246815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:58.247258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:58.248073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:58.248458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:58.378391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:58.386351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-38fc340c-8b8f-4fa0-ac27-98d75cf31c0a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151021 May 16 17:20:58.386925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1105/2515] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:58 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:59.093844 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:59.094465 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:59.100807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:59.101261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:59.102069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:59.102509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:59.161853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:59.169560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e02efd29-5369-42bb-accf-9b866968d559 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079657 May 16 17:20:59.170161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1411/2516] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:20:59.403376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:20:59.403993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:20:59.410803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:59.411013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:59.411733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:20:59.412176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:20:59.542551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:20:59.550440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8642eb6e-a4e1-4d45-bd3a-0115acc46752 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151526 May 16 17:20:59.551018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1106/2517] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:20:59 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:00.187107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:00.187748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:00.194042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:00.194488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:00.195244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:00.195679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:00.255519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:00.263774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f86f864b-e436-4d30-a3aa-60c5ea8eab53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080635 May 16 17:21:00.264338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1412/2518] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:00.568335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:00.568881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:00.575850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:00.576297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:00.577060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:00.577495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:00.705145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:00.713668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-168a8b9a-e331-4a64-bbb2-629a58dcb7fa tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149248 May 16 17:21:00.714262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1107/2519] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:00 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:01.280234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:01.280836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:01.287117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:01.287569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:01.288326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:01.288764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:01.355064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:01.362892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6c6ce55b-49c8-47bc-a742-57032ef34af0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086512 May 16 17:21:01.363459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1413/2520] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:01.730570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:01.731211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:01.737675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:01.738166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:01.738905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:01.739338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:01.870036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:01.878592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bb7bdee2-1036-4613-a39b-9482c1ca76d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152477 May 16 17:21:01.879174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1108/2521] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:01 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:02.380080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:02.380698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:02.387311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:02.387763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:02.388534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:02.388968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:02.448947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:02.456692 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-01f5c85e-5762-4c8f-afb2-461ee62045ec tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080445 May 16 17:21:02.457264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1414/2522] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:02.897569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:02.899364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:02.909958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:02.910416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:02.911194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:02.911663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:03.037394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:03.045665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-96ff7005-69b5-4709-882d-8c6cdc4978e7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152039 May 16 17:21:03.046261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1109/2523] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:02 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:03.474219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:03.474834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:03.481052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:03.481495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:03.482265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:03.482695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:03.542373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:03.550014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-eb3d8897-6057-43fe-8893-071539ededb2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079617 May 16 17:21:03.550574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1415/2524] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:04.062648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:04.063291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:04.070615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:04.071409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:04.072172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:04.072604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:04.207292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:04.215599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fc005c5e-7651-45ed-a40e-a9fc93c82a15 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.156767 May 16 17:21:04.216169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1110/2525] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:04 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:04.567447 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:04.568049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:04.576538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:04.576992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:04.577780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:04.578225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:04.643711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:04.652053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8c96b55e-4047-439f-afa0-d6bbd4b0c20b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088500 May 16 17:21:04.652629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1416/2526] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:05.233327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:05.234000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:05.240942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:05.241402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:05.242205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:05.242647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:05.368216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:05.376710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-98e29d7b-c113-4d1a-b8bf-7f133fbd0279 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148025 May 16 17:21:05.377288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1111/2527] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:05 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:05.669462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:05.670084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:05.676527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:05.676974 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:05.677814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:05.678257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:05.742970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:05.751268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3f5739d7-29b2-43f9-95ca-a95183dc98bf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085731 May 16 17:21:05.751840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1417/2528] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:06.393944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:06.394558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:06.400957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:06.401403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:06.402371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:06.402816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:06.532854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:06.540668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-68d3fb2e-391b-4702-8419-8d9aa56585e2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150802 May 16 17:21:06.541244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1112/2529] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:06 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:06.768137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:06.768701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:06.774992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:06.775436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:06.776182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:06.776611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:06.837007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:06.844779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c03b6b85-68e8-4ef3-9cd4-7b0e96559b04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080566 May 16 17:21:06.845536 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1418/2530] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:07.558946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:07.559481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:07.565810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:07.566257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:07.567014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:07.567448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:07.702752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:07.711828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4587691f-3bc5-4ed7-b228-2b8b7dedaf5e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.157455 May 16 17:21:07.712422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1113/2531] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:07 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:07.862257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:07.862856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:07.869063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:07.869502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:07.870280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:07.871284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:07.931088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:07.939476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-403a4512-a41c-4e3f-b0c6-7fd09da9f7d6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081043 May 16 17:21:07.940048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1419/2532] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:08.729526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:08.730714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:08.736928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:08.737386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:08.738189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:08.738633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:08.864295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:08.872008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fd95e65f-a357-4504-a2aa-a4822a25905d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146417 May 16 17:21:08.872611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1114/2533] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:08 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:08.956913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:08.957843 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:08.964083 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:08.965039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:08.965826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:08.966261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:09.032480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:09.040351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f0e66c71-51d1-4c78-9586-3598b81e3396 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087337 May 16 17:21:09.040986 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1420/2534] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:09.889539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:09.890161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:09.896413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:09.896862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:09.897612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:09.898072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:10.024996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:10.033675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7c814392-5efe-4f6e-805b-8927d33a5ce5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148565 May 16 17:21:10.034282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1115/2535] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:09 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:10.056198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:10.056808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:10.063571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:10.064017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:10.064779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:10.065193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:10.128186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:10.135875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-68ca3533-7250-4763-bd3f-47f00a892891 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083431 May 16 17:21:10.136479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1421/2536] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:11.051347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:11.051962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:11.058401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:11.058858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:11.059628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:11.060071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:11.152900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:11.153512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:11.159744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:11.160189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:11.160956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:11.161386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:11.186495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:11.194357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5712dd86-6cad-4f1f-9baf-ccc5620c00a5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146878 May 16 17:21:11.194938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1116/2537] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:11.221488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:11.229173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-97fe649e-4be0-4b62-8ede-ff6b28974e21 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080700 May 16 17:21:11.229823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1422/2538] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:12.211972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:12.212727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:12.219422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:12.219867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:12.220622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:12.221076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:12.247059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:12.247673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:12.254029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:12.254487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:12.255257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:12.255693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:12.316262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:12.325239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1f745b0f-e430-471c-9388-7225a349553b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082582 May 16 17:21:12.325845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1423/2539] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:12.353116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:12.360952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae3112de-6187-43e1-98c4-db2a5fc70472 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152850 May 16 17:21:12.361524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1117/2540] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:12 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:13.342358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:13.342971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:13.349273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:13.349723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:13.350516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:13.350957 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:13.378514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:13.379127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:13.385463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:13.385949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:13.387282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:13.387725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:13.411740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:13.419994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-259ec019-5496-4de6-92df-67ad3ee21e2b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081419 May 16 17:21:13.420574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1424/2541] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:13.513684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:13.521668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ebce427f-04d7-436b-8fd9-6667eab9c455 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146880 May 16 17:21:13.522223 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1118/2542] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:14.436367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:14.437682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:14.444064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:14.444511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:14.445268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:14.445701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:14.508830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:14.517150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a3788886-b140-4acb-999f-5c11b1f16e3e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084623 May 16 17:21:14.517786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1425/2543] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:14.538609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:14.539226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:14.546008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:14.546455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:14.547215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:14.547650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:14.673671 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:14.681336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3199d331-c157-48a0-b17b-ce0c1723410d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146571 May 16 17:21:14.681937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1119/2544] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:14 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:15.533619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:15.534227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:15.540433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:15.540926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:15.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:15.542211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:15.603637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:15.612876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b28ffc74-5bf3-44b2-ba2c-a13695ff0bd0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083162 May 16 17:21:15.613456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1426/2545] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:15.699255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:15.699869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:15.705728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:15.706210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:15.706970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:15.707664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:15.836357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:15.844248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-05733faa-0b36-48a3-a778-b778255a1b89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149684 May 16 17:21:15.844853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1120/2546] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:15 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:16.632257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:16.632864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:16.639373 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:16.639821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:16.640588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:16.641024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:16.701639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:16.709697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-45fd9f7b-9edc-4187-aabe-b178e200f6fc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081452 May 16 17:21:16.710289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1427/2547] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:16.860900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:16.861513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:16.867802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:16.868255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:16.869048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:16.869489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:17.001383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:17.009123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3e0c9729-00a7-40d7-baf8-1d96f919ad41 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152128 May 16 17:21:17.009687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1121/2548] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:16 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:17.726157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:17.726768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:17.733573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:17.734050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:17.734812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:17.735245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:17.794426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:17.802059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d39a8a89-b1af-40bc-84ec-d89709cc6901 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079767 May 16 17:21:17.802626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1428/2549] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:18.026813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:18.027383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:18.033881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:18.034339 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:18.035090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:18.035521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:18.167202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:18.174850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-92d19bb0-4a56-4d2a-a143-d9cd238ea047 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152034 May 16 17:21:18.175413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1122/2550] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:18.819511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:18.820060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:18.826681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:18.827125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:18.827876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:18.828307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:18.890826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:18.898470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cb085683-6a82-463a-a09b-0232eb245b9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082870 May 16 17:21:18.899038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1429/2551] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:19.192353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:19.192972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:19.199494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:19.199949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:19.200715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:19.201151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:19.327365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:19.335435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2caf0a00-6a58-47cf-bd63-2aead85763dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147040 May 16 17:21:19.336006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1123/2552] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:19 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:19.915368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:19.915965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:19.922926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:19.923369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:19.924127 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:19.924559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:19.984677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:19.992442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9a1ed765-5072-42c4-b6bb-1a957bc67494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080944 May 16 17:21:19.993016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1430/2553] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:20.352424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:20.353039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:20.359875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:20.360330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:20.361099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:20.361540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:20.489574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:20.499024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-607a677c-8b23-479c-a8c2-fe6da4cbb2e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150470 May 16 17:21:20.499599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1124/2554] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:20 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:21.009935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:21.010552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:21.017072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:21.017541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:21.018350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:21.018791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:21.078291 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:21.086244 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-85c67bb6-47a5-47a0-88a8-c980c4483fc3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080163 May 16 17:21:21.086821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1431/2555] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:21.516089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:21.516701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:21.523034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:21.523425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:21.524180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:21.524609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:21.650684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:21.658512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-448ad959-e6e8-4900-88d8-79bf8fbf7acc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146324 May 16 17:21:21.659081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1125/2556] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:21 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:22.103480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:22.104097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:22.110903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:22.111348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:22.112108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:22.112545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:22.171361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:22.179018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-82d4bb48-3773-4785-935e-1fc652dd34b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079416 May 16 17:21:22.179588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1432/2557] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:22.675592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:22.676154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:22.682421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:22.682876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:22.683637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:22.684066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:22.814617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:22.822351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-984a557d-8ebc-413d-8898-8154e7f5995d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150740 May 16 17:21:22.822920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1126/2558] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:22 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:23.195239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:23.195846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:23.202813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:23.203256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:23.204008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:23.204437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:23.267829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:23.275484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-338236ea-f37f-4e2d-83d8-8ce6f1b78825 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084105 May 16 17:21:23.276046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1433/2559] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:23.839623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:23.840257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:23.846680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:23.847135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:23.847911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:23.848349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:23.978823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:23.987015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b11a440b-109f-431a-af5c-b61e4165e459 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151248 May 16 17:21:23.987586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1127/2560] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:24.291442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:24.291996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:24.298719 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:24.299176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:24.299931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:24.300361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:24.361335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:24.369094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c3d66e42-95ce-4eae-b429-43cb928f6499 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081554 May 16 17:21:24.369668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1434/2561] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:25.004638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:25.005333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:25.011683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:25.012130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:25.012884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:25.013890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:25.137888 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:25.146848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2b0bac08-aedd-4009-b2c5-18384f40dca0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146095 May 16 17:21:25.147475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1128/2562] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:24 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:25.385663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:25.386339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:25.393275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:25.393725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:25.394574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:25.395005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:25.455799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:25.463713 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-493b928b-caaf-443b-b3aa-bb20d701f375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081951 May 16 17:21:25.464277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1435/2563] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:26.164266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:26.164879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:26.171646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:26.172092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:26.172845 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:26.173279 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:26.301069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:26.308675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f0428b54-a2c8-46b9-8514-3e72fb12a936 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148287 May 16 17:21:26.309240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1129/2564] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:26 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:26.480396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:26.480953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:26.487344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:26.487792 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:26.488546 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:26.488978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:26.550359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:26.558030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a2b8ab22-a4a3-4286-af70-5792ee8674ee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081523 May 16 17:21:26.558603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1436/2565] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:27.325603 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:27.326287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:27.332948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:27.333414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:27.334190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:27.334631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:27.459840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:27.468088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a4cb605c-dfb0-41e2-a81c-07911bef52d2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146399 May 16 17:21:27.468659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1130/2566] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:27.575594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:27.576183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:27.582748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:27.583196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:27.583954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:27.584385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:27.646620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:27.654753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bb2a620b-1fff-47fe-90cc-096f295897ad tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083103 May 16 17:21:27.655315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1437/2567] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:28.485222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:28.485871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:28.492275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:28.492732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:28.493499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:28.493968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:28.635101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:28.643093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c104bb9d-b647-4ba5-a0fe-e8a61a123690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.162604 May 16 17:21:28.643670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1131/2568] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:28.671922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:28.672494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:28.678854 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:28.679305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:28.680066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:28.680504 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:28.743025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:28.751175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a17f668f-1f5a-44db-ad00-047d6bbb661b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083614 May 16 17:21:28.751737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1438/2569] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:29.660810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:29.661437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:29.667721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:29.668172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:29.668934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:29.670012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:29.767431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:29.768048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:29.774333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:29.774784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:29.775551 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:29.775989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:29.801679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:29.809455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1a6c37c3-023e-4521-a3d5-597be5e0777e tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152500 May 16 17:21:29.810101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1132/2570] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:29 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:29.839302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:29.847558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9f08f53c-01c5-408e-9d91-a310028f1df7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083981 May 16 17:21:29.848133 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1439/2571] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:30.825886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:30.826500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:30.833010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:30.833467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:30.834288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:30.834996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:30.864321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:30.865027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:30.871401 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:30.871923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:30.873395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:30.873936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:30.973558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:30.982694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7b92d411-d8f8-4ded-82ed-ca4235c899b7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.160118 May 16 17:21:30.983295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1133/2572] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:31.098057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:31.105625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-977aa36b-50fb-444a-8ef1-37bee7f1c722 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.245096 May 16 17:21:31.106197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1440/2573] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:31.999916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:32.000502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:32.006755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:32.007193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:32.007953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:32.008387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:32.124417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:32.125194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:32.131556 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:32.132088 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:32.132969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:32.133479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:32.136465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:32.144835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3c54b9a5-f71b-4520-a40f-0f4208682df0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149354 May 16 17:21:32.145409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1134/2574] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:31 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:32.198064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:32.206111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-77cce004-ff55-4416-85bc-2233dd802c68 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086748 May 16 17:21:32.206668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1441/2575] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:33.161899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:33.162524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:33.168919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:33.169376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:33.170197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:33.170634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:33.223076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:33.223721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:33.230181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:33.230821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:33.231626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:33.232055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:33.292497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:33.298401 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:33.301135 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6fa8c095-190c-412b-abb5-1cac09b95797 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082356 May 16 17:21:33.301807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1442/2576] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:33.306292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-03f3b1b2-3377-4052-86a1-8773a38c87dc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148257 May 16 17:21:33.306853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1135/2577] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:33 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:34.318887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:34.319519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:34.324418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:34.325040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:34.326295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:34.326748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:34.327526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:34.327963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:34.331951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:34.332661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:34.333428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:34.333894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:34.388919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:34.396680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b4e35908-4143-4a2b-b7c2-367d6a3b211f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081666 May 16 17:21:34.397243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1443/2578] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:34 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:34.462856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:34.470658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ffd1b98c-0e6b-4954-8412-158dbb0dc7e4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151134 May 16 17:21:34.471231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1136/2579] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:34 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:34.890128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:34.890623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:34.896514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:34.896964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:34.897722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:34.898180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:34.926183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:21:34.999304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-383d26df-7cba-428f-88b9-45ee70243393 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 204 len: 0 microversion: 2.20 time: 0.112727 May 16 17:21:35.000061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1444/2580] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 16 17:21:34 2022] DELETE /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:21:35.009099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:35.009721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:35.015656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:35.016111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:35.016880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:35.017318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:35.142582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:35.150249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:35.151793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:35.152979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d1a0e908-e109-4ebc-97a2-6caafec5eda6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1724 microversion: 2.20 time: 0.148624 May 16 17:21:35.153542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1137/2581] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:21:35 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:21:35.414166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:35.414809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:35.421040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:35.421491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:35.422776 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:35.423211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:35.486424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:35.488887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:35.489509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:35.494301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1f804146-104b-4794-bfc7-b7adc2ded5d7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084427 May 16 17:21:35.494873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1445/2582] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:35 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:35.495894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:35.496347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:35.497119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:35.497555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:35.623022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:35.630802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3b5ddc28-491d-446a-8f7f-0f7b4741477a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147078 May 16 17:21:35.631381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1138/2583] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:35 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:36.171281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:36.171880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:36.177685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:36.178156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:36.178904 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:36.179334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:36.313423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:36.321460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:36.322963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:36.324113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bec82f2f-ec46-498c-90bd-66f6f7052d35 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1724 microversion: 2.20 time: 0.156735 May 16 17:21:36.324669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1446/2584] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:21:36 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:21:36.511226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:36.511772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:36.518824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:36.519271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:36.520034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:36.520467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:36.588089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:36.596057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e6a484b-3cd2-43f7-8b27-39aa9e6ef677 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088722 May 16 17:21:36.596641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1139/2585] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:36.647866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:36.648620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:36.655275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:36.655728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:36.656511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:36.656949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:37.094341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:37.102097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-becf56c5-3da3-4b64-9bef-2f84c9dee6c4 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.458076 May 16 17:21:37.102673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1447/2586] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:36 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:37.344861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:37.345472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:37.351390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:37.351839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:37.352604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:37.353035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:37.418087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:37.426145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:37.427682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:37.428876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb5e8e00-7830-4408-ae76-a61cf32125e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 200 len: 1656 microversion: 2.20 time: 0.088526 May 16 17:21:37.429447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1140/2587] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:21:37 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:21:37.612503 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:37.613121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:37.618905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:37.619355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:37.620220 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:37.620582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:37.637204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-4c3bc5a3-001b-4be3-9c62-f0d35a665e8e req-b0e3f8ad-0792-49ed-8b20-07cac193f83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50aa4da-9029-4dae-bc88-51d80ddbb215", "name": "network-vif-deleted", "tag": "ed53643e-bfe8-4cf9-ada9-27da0c055154"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:21:37.653252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-4c3bc5a3-001b-4be3-9c62-f0d35a665e8e req-b0e3f8ad-0792-49ed-8b20-07cac193f83e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:37.654075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-4c3bc5a3-001b-4be3-9c62-f0d35a665e8e req-b0e3f8ad-0792-49ed-8b20-07cac193f83e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:37.666627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-4c3bc5a3-001b-4be3-9c62-f0d35a665e8e req-b0e3f8ad-0792-49ed-8b20-07cac193f83e service nova] Creating event network-vif-deleted:ed53643e-bfe8-4cf9-ada9-27da0c055154 for instance a50aa4da-9029-4dae-bc88-51d80ddbb215 on hv-cinder-83998 May 16 17:21:37.673417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-4c3bc5a3-001b-4be3-9c62-f0d35a665e8e req-b0e3f8ad-0792-49ed-8b20-07cac193f83e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039321 May 16 17:21:37.675037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1141/2588] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:21:37.701086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:37.711278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4649cba9-c74d-49ea-9017-0bbb9612e5c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.102654 May 16 17:21:37.711938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1448/2589] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:38.120948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:38.121663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:38.129206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:38.129767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:38.130604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:38.131176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:38.268665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:38.276857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5182c52f-7d2c-42e0-9652-61fc74d47fe3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.160773 May 16 17:21:38.277553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1142/2590] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:38 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:38.446671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:38.447319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:38.453534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:38.454018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:38.454798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:38.455232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:38.469695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] HTTP exception thrown: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Request method failure captured: May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 HTTP/1.1 May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJOYq7A2zC7aJIKkY94WOgT3Mq8mAKo6OS9vGmVf91cM7NXMu3zRbUwa5iQ4ZPMwxPtlN9GJ5iVIXGA5rn3Bn3GcJJ9_MGA1jdJ9pg8jQAUh_UojrNQhpCxws77tuEXBbsJn7_9n95bEG9VB1eyCRLpfqTCYQ565KUxZdIBvbKWaBk May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:21:38.471606 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 58633f982d3840dd88f631bcee882f5f May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:38.473295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'a50aa4da-9029-4dae-bc88-51d80ddbb215'} May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:21:38.474347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:38.475920 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:38.477161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Returning 404 to user: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:21:38.477161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-22fa7745-5a77-4616-b709-adbba7f044cf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 404 len: 111 microversion: 2.20 time: 0.031574 May 16 17:21:38.477161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1449/2591] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:21:38 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:21:38.483855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e34465fb-cf8a-4937-a891-3fec329ce742 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '.version_select at 0x7feace1d4dc0>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:38.503648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e34465fb-cf8a-4937-a891-3fec329ce742 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792796251" status: 204 len: 0 microversion: 2.20 time: 0.023559 May 16 17:21:38.504248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1143/2592] 10.222.0.70 () {60 vars in 1258 bytes} [Mon May 16 17:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792796251 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:21:38.728590 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:38.729207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:38.736518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:38.737068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:38.737955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:38.738469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:38.807730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:38.816797 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4b662895-1449-4a91-931b-b53394ea7560 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.092073 May 16 17:21:38.817365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1450/2593] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:39.138855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:39.139391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:39.145708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.146191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.146961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.147402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.160878 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] HTTP exception thrown: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Request method failure captured: May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 HTTP/1.1 May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJOYq7A2zC7aJIKkY94WOgT3Mq8mAKo6OS9vGmVf91cM7NXMu3zRbUwa5iQ4ZPMwxPtlN9GJ5iVIXGA5rn3Bn3GcJJ9_MGA1jdJ9pg8jQAUh_UojrNQhpCxws77tuEXBbsJn7_9n95bEG9VB1eyCRLpfqTCYQ565KUxZdIBvbKWaBk May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:21:39.162566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 58633f982d3840dd88f631bcee882f5f May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.164264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'a50aa4da-9029-4dae-bc88-51d80ddbb215'} May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:21:39.165197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.166742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:21:39.168389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Returning 404 to user: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:21:39.168389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-295d5f9e-5ebb-4235-9114-e707c5a590ec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 404 len: 111 microversion: 2.20 time: 0.029571 May 16 17:21:39.168389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1144/2594] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 16 17:21:39 2022] DELETE /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:21:39.172452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:39.173067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: a50aa4da-9029-4dae-bc88-51d80ddbb215] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:39.178943 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.179446 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.180234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.180698 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.193611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] HTTP exception thrown: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Request method failure captured: May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 HTTP/1.1 May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJOYq7A2zC7aJIKkY94WOgT3Mq8mAKo6OS9vGmVf91cM7NXMu3zRbUwa5iQ4ZPMwxPtlN9GJ5iVIXGA5rn3Bn3GcJJ9_MGA1jdJ9pg8jQAUh_UojrNQhpCxws77tuEXBbsJn7_9n95bEG9VB1eyCRLpfqTCYQ565KUxZdIBvbKWaBk May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:21:39.195162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 58633f982d3840dd88f631bcee882f5f May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.196655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'a50aa4da-9029-4dae-bc88-51d80ddbb215'} May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:21:39.197386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. May 16 17:21:39.198668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:21:39.199755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Returning 404 to user: Instance a50aa4da-9029-4dae-bc88-51d80ddbb215 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:21:39.199755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bfdf7bdd-f8e1-4972-b6ff-5645ff3d4fbb tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215" status: 404 len: 111 microversion: 2.20 time: 0.028020 May 16 17:21:39.199755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1451/2595] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:21:39 2022] GET /compute/v2.1/servers/a50aa4da-9029-4dae-bc88-51d80ddbb215 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:21:39.294192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:39.294807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:39.300778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.301226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.302011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.302442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.427533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:39.435389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2f7fbbfd-3f12-4ea3-b0e4-169ee5baf61f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145082 May 16 17:21:39.435952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1145/2596] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:39 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:39.833887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:39.834501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:39.840754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.841211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.842010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:39.842449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:39.902206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:39.910006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-29329fd3-1d21-4535-b03c-218a34e3fd99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080249 May 16 17:21:39.910564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1452/2597] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:40.452141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:40.452757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:40.460243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:40.460693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:40.461459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:40.461932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:40.585714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:40.593434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ce67e392-c4fb-4b2b-a285-806e0a204b67 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145182 May 16 17:21:40.594636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1146/2598] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:40 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:40.927172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:40.927808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:40.934051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:40.934502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:40.935255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:40.935689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:40.996464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:41.004662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4188735c-ab8b-4f8e-9a9c-9f64eeb7cc3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081304 May 16 17:21:41.005219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1453/2599] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:41.613072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:41.613881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:41.621314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:41.621843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:41.622727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:41.623233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:41.775966 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:41.784943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6f93bb9e-2736-4a33-be2c-e174b80e2aab tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.177428 May 16 17:21:41.785445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1147/2600] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:41 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:42.022335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:42.023089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:42.030581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:42.032071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:42.034382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:42.034382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:42.092735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:42.101204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0e616d2a-7223-465c-845a-3a84530f381b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082951 May 16 17:21:42.101812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1454/2601] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:42.646398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-5fa4056a-ea68-44af-a9ce-1bec0ef663f6 req-1f448a2b-4d94-4f46-8384-98a46ffbe441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f9c81-9fa1-430d-9691-d04ea3c538de", "name": "network-vif-deleted", "tag": "6007958b-9440-43dd-b6aa-eea9a3fae357"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:21:42.655812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5fa4056a-ea68-44af-a9ce-1bec0ef663f6 req-1f448a2b-4d94-4f46-8384-98a46ffbe441 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:42.656255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5fa4056a-ea68-44af-a9ce-1bec0ef663f6 req-1f448a2b-4d94-4f46-8384-98a46ffbe441 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:42.673068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-5fa4056a-ea68-44af-a9ce-1bec0ef663f6 req-1f448a2b-4d94-4f46-8384-98a46ffbe441 service nova] Creating event network-vif-deleted:6007958b-9440-43dd-b6aa-eea9a3fae357 for instance 066f9c81-9fa1-430d-9691-d04ea3c538de on hv-cinder-83998 May 16 17:21:42.681947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-5fa4056a-ea68-44af-a9ce-1bec0ef663f6 req-1f448a2b-4d94-4f46-8384-98a46ffbe441 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039068 May 16 17:21:42.682544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1148/2602] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:21:42.802302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:42.802935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:42.808722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:42.809167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:42.809948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:42.810378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:42.936522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:42.944763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fadb6a97-7629-42e7-97a7-a008536ba226 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146238 May 16 17:21:42.945346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1455/2603] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:42 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:43.118918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:43.119628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:43.126304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:43.126759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:43.127524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:43.127965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:43.187270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:43.195495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d7cf3a05-8039-4e41-82dc-30968cb061d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080942 May 16 17:21:43.196060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1149/2604] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:43.966149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:43.966149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:43.970281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:43.970729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:43.971496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:43.971955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:44.113569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:44.121258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a02f54f8-029d-45ea-8b54-1892009cd7b6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.162587 May 16 17:21:44.121835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1456/2605] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:43 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:44.213144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:44.213781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:44.220852 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:44.221250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:44.222044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:44.222480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:44.280945 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:44.289309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-26289217-9672-436d-893e-3a6c1f1e5571 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080064 May 16 17:21:44.289904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1150/2606] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:45.138639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:45.139250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:45.145173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:45.145614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:45.146392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:45.146818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:45.308382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:45.309000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:45.315046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:45.315499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:45.316258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:45.316695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:45.336156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:45.344029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e0e5033b-6c3e-42b1-982c-fd310c0184d7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.209181 May 16 17:21:45.345110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1457/2607] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:45 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:45.384049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:21:45.384230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:45.384350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:21:45.392213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-91b10630-8986-4f32-9046-89465b15c8f6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087631 May 16 17:21:45.392720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1151/2608] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:46.363830 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:46.364441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:46.370723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:46.371175 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:46.371938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:46.372365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:46.408799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:46.409586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:46.416310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:46.416864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:46.417644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:46.418099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:46.479155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:46.487536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1ca27d7b-3498-4865-bee8-0c77d84cdb41 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082601 May 16 17:21:46.488199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1152/2609] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:46.504491 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:46.512355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6f12d63d-d973-4745-843a-6cae60104690 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152844 May 16 17:21:46.512956 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1458/2610] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:46 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:47.504539 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:47.505163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:47.511540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:47.511996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:47.512767 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:47.513266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:47.529362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:47.529994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:47.536780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:47.537182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:47.537968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:47.538384 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:47.573602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:47.581407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eda50e5f-e42d-4adb-a13d-9632bf8d4ec6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080739 May 16 17:21:47.582283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1153/2611] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:47.664117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:47.671915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-000dc399-5875-4d8b-ac85-3376915bae89 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146394 May 16 17:21:47.673113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1459/2612] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:47 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:21:48.598460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:48.599072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:48.605498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:48.605992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:48.606797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:48.607240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:48.666562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:48.674812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-67f1f2b7-422e-43c1-a2a4-c419ee280273 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080164 May 16 17:21:48.675380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1154/2613] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:48.691347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:48.691969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:48.698280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:48.698736 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:48.699508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:48.699950 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:48.825271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:48.833093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-de16f0c3-f052-43cf-9dfa-cc7fee43edac tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146289 May 16 17:21:48.833646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1460/2614] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:48 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:49.692463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:49.693084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:49.699528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:49.699984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:49.706351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:49.707061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:49.774989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:49.783133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-413933e9-1b94-478e-8a09-858706938362 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.095168 May 16 17:21:49.783697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1155/2615] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:49.850397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:49.851003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:49.856819 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:49.857258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:49.858036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:49.858464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:49.986012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:49.993595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f6ef575b-7623-4849-b23c-a445d42b8490 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146887 May 16 17:21:49.994189 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1461/2616] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:49 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:50.800288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:50.801102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:50.807796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:50.808253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:50.809022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:50.809465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:50.873038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:50.881606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0931db3c-e52c-4f24-8937-d049e4325a6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085598 May 16 17:21:50.882217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1156/2617] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:51.010614 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:51.011229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:51.018186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:51.018634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:51.019399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:51.019834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:51.150880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:51.158582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-678ba24f-165e-49a4-abea-502e7c25e038 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151829 May 16 17:21:51.159149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1462/2618] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:51 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:51.898851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:51.899463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:51.905710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:51.906181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:51.906965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:51.907398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:51.968187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:51.976286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a428d85d-e06c-486b-9def-8c4830d7d2c4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081392 May 16 17:21:51.976881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1157/2619] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:52.175581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:52.176123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:52.182413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:52.182863 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:52.183625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:52.184063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:52.309630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:52.317836 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-01dd62ea-9204-4d49-9c75-0cb94c8f64b0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146271 May 16 17:21:52.318901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1463/2620] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:52 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:52.994326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:52.994930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:53.001192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:53.001651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:53.002474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:53.002910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:53.061991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:53.069627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-91ce4b65-7519-452d-9881-19c3d37e8bb5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079186 May 16 17:21:53.070217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1158/2621] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:53.334728 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:53.335339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:53.341537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:53.342009 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:53.342763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:53.343193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:53.467297 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:53.475423 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7e97623b-b239-4f99-87bf-a573575ad149 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144816 May 16 17:21:53.475983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1464/2622] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:53 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:54.088125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:54.088744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:54.095897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:54.096359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:54.097146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:54.097614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:54.157431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:54.165383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1b6206d8-3cbd-4e47-9768-255aa309284f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081073 May 16 17:21:54.165996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1159/2623] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:54.492442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:54.493094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:54.499417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:54.499864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:54.500622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:54.501056 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:54.632180 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:54.639945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4a58a21a-4897-4c4d-b77b-c555281c518f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151340 May 16 17:21:54.640508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1465/2624] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:54 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:55.182807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:55.183419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:55.190196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:55.190643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:55.191396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:55.191829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:55.253831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:55.261841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-15835616-fbd0-40ea-ab9b-42d75bdd7f3a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082516 May 16 17:21:55.262407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1160/2625] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:55.656949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:55.657552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:55.663789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:55.664234 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:55.664992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:55.665424 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:55.795078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:55.803473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5ffaa330-4178-4971-a54d-30115f9e7751 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150522 May 16 17:21:55.804043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1466/2626] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:55 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:56.279332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:56.279940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:56.286463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:56.286923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:56.287696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:56.288166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:56.347879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:56.355842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d082ab8d-fb78-4bfd-8ff5-b7e245a710be tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080364 May 16 17:21:56.356408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1161/2627] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:56.820381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:56.821029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:56.827314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:56.827761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:56.828517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:56.829454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:56.958443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:56.966122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9be600db-29f0-4a40-a570-fa75b5b21da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149594 May 16 17:21:56.966680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1467/2628] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:56 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:57.373174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:57.373812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:57.380264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:57.380726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:57.381493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:57.381971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:57.455449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:57.463572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-046deaef-f148-4c90-8399-fc113f9707bc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.094263 May 16 17:21:57.464149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1162/2629] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:57.983870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:57.984512 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:57.990988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:57.991460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:57.992228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:57.992664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:58.124681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:58.138268 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-33c42981-77ad-41e4-80ab-f597d2badc92 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.158220 May 16 17:21:58.143163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1468/2630] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:57 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:58.480304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:58.480914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:58.487751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:58.488197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:58.488952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:58.489385 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:58.549727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:58.557545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1312b0bb-28e9-473d-9536-9cfcdfe9ad38 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081072 May 16 17:21:58.558140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1163/2631] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:59.156152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:59.156707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:59.162946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:59.163388 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:59.164132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:59.164561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:59.287225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:59.294917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b08789c6-acd7-462b-a8e9-0e18aae1c826 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.142813 May 16 17:21:59.295490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1469/2632] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:59 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:21:59.575617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:21:59.576240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:21:59.583591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:59.584049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:59.584825 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:21:59.585268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:21:59.647495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:21:59.655311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e402847-11d7-41bc-b59f-c1f835b0e494 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083624 May 16 17:21:59.655887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1164/2633] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:21:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:00.312846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:00.313520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:00.319851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:00.320288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:00.321052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:00.321493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:00.452749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:00.460993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-13467c0b-dce6-4d3f-9eee-41f175930927 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152415 May 16 17:22:00.461573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1470/2634] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:00 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:00.671417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:00.672036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:00.678406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:00.678855 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:00.679610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:00.680051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:00.739926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:00.747669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fc7f6b17-b7df-4929-9e32-7c35772d168f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080086 May 16 17:22:00.748246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1165/2635] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:01.478529 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:01.479143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:01.485541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:01.486019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:01.486781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:01.487212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:01.612260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:01.619928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-066dec6b-7cc4-48ea-9aa7-888fabcbafe0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145265 May 16 17:22:01.620495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1471/2636] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:01 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:01.764406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:01.765025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:01.771967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:01.772421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:01.773183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:01.773621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:01.840910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:01.843831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-97747f5a-45ea-41e1-b5f3-ab1afd8d3e28 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083298 May 16 17:22:01.844577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1166/2637] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:02.472203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:22:02.472387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:22:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:22:02.639177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:02.640663 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:02.647826 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:02.648273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:02.649831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:02.650278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:02.776882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:02.784805 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-67bdd9ac-a8f3-4b2d-8818-9e8350aecdc1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150057 May 16 17:22:02.785400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1472/2638] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:02 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:02.860866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:02.862090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:02.868933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:02.869383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:02.870205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:02.870638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:02.933599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:02.941900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c888b62d-8fff-4c44-ba84-74dd55bdcdef tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084978 May 16 17:22:02.942484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1167/2639] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:03.802531 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:03.803191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:03.810091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:03.810542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:03.811327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:03.811766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:03.949203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:03.958102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5f35f880-e80a-43f6-b1b5-369013bb7eda tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.159493 May 16 17:22:03.958862 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1473/2640] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:03 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:03.960040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:03.960670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:03.967300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:03.967759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:03.968532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:03.968975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:04.032723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:04.040563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-64c9d472-7831-446b-a29a-ccbef40bdb85 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085253 May 16 17:22:04.041135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1168/2641] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:04.975710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:04.976323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:04.982654 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:04.983102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:04.983859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:04.984300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:05.056398 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:05.057208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:05.063666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:05.064124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:05.065567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:05.066032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:05.119507 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:05.127833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9e6f5ed9-9ec2-403d-bcac-17be908a4bf5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155440 May 16 17:22:05.128404 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1474/2642] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:04 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:05.134499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:05.142349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c5f5c1a2-c938-4699-9abb-215c532237c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.089813 May 16 17:22:05.142904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1169/2643] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:06.144936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:06.145544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:06.151829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:06.152280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:06.153058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:06.153482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:06.159600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:06.160304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:06.166563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:06.167013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:06.167786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:06.168221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:06.229628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:06.237450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5dde1a91-2340-46e0-9e4a-c3f0eb42e61e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082232 May 16 17:22:06.238056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1170/2644] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:06.285697 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:06.293357 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d2cac8dc-2f81-47e5-973a-ed047b836838 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152772 May 16 17:22:06.293952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1475/2645] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:06 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:07.254684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:07.255303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:07.261587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:07.262068 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:07.262828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:07.263271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:07.310349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:07.310989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:07.317820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:07.318269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:07.319022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:07.319454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:07.323624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:07.331280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-24ef000d-4c70-4aed-b132-1d42e1ea4ff5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080960 May 16 17:22:07.332118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1171/2646] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:07.444600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:07.452437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0b6d003c-fcb4-4a72-a07f-731ffcb895f3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146016 May 16 17:22:07.452985 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1476/2647] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:07 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:08.348415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:08.349030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:08.356246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:08.356700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:08.357474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:08.357955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:08.470214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:08.470214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:08.470752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:08.477464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:08.477975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:08.478345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-12019899-5c32-4c8f-9e23-b0083f8abb0a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.133761 May 16 17:22:08.478748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:08.479181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:08.479301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1172/2648] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:08.619640 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:08.631860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a11f50f8-0049-47ef-bd1c-5b43ba74db8f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.166529 May 16 17:22:08.632429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1477/2649] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:08 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:09.495334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:09.495981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:09.502870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:09.503328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:09.504097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:09.504538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:09.564123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:09.572414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d6b22169-3b7f-42e1-89b8-0073dcdd528c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080995 May 16 17:22:09.572985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1173/2650] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:09.648548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:09.649167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:09.655407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:09.655850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:09.656603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:09.657030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:09.782323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:09.790086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-db596acc-bb6e-4ce2-b3a9-e555c73305f8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145387 May 16 17:22:09.790652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1478/2651] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:09 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:10.589032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:10.589642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:10.596599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:10.597052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:10.597836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:10.598269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:10.656329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:10.664706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-818034ee-9073-4a0a-a829-cd007a673e11 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079489 May 16 17:22:10.665220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1174/2652] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:10.807125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:10.807746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:10.813992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:10.814949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:10.815711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:10.816148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:10.942249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:10.949899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-55e20e28-803c-48d2-b266-acb7013a7d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146582 May 16 17:22:10.950469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1479/2653] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:10 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:11.681515 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:11.682159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:11.688410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:11.688860 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:11.689625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:11.690089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:11.750929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:11.758668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-75210ada-15a0-4b2a-ab20-2a6549d9718e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081031 May 16 17:22:11.759232 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1175/2654] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:11.967499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:11.968024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:11.974940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:11.975385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:11.976132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:11.976565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:12.101267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:12.108890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5196adf8-3361-4652-bbef-c0e0d74a44ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145266 May 16 17:22:12.109449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1480/2655] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:12.775301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:12.775840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:12.782851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:12.783962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:12.784742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:12.785183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:12.849002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:12.856861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-92d842ae-323a-431a-8a74-51c250091d14 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085508 May 16 17:22:12.857449 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1176/2656] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:13.125909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:13.126538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:13.133339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:13.133821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:13.134599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:13.135044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:13.264403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:13.272658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d35edf27-2343-49ca-b634-caa59923c6a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150674 May 16 17:22:13.273223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1481/2657] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:13.873848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:13.874469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:13.880866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:13.881321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:13.882105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:13.882543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:13.941665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:13.949327 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1c85e3a0-a067-4b7a-91f7-a2f0cf398538 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079444 May 16 17:22:13.949917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1177/2658] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:14.290202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:14.290746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:14.297038 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:14.297489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:14.298271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:14.298710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:14.432292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:14.440480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b9bebbaf-89fc-4c4b-bd77-89095d963f13 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.154181 May 16 17:22:14.441052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1482/2659] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:14 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:14.966559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:14.967148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:14.973253 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:14.973703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:14.974488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:14.974920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:15.033557 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:15.041135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6cd20435-1e2f-41d6-821a-220e22522ae3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.078439 May 16 17:22:15.041702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1178/2660] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:15.457710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:15.458367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:15.464772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:15.465231 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:15.466017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:15.466467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:15.591422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:15.599720 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a859f362-626e-4b5c-9193-20065494facb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146701 May 16 17:22:15.600287 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1483/2661] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:15 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:16.058722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:16.059269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:16.066109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:16.066562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:16.067329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:16.067770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:16.128731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:16.136417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c6b2d4db-c339-48e7-bc53-f5eb7e664859 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081652 May 16 17:22:16.136986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1179/2662] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:16.617399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:16.618025 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:16.624252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:16.624695 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:16.625455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:16.625988 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:16.752168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:16.759851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-97fca622-e9ec-46f6-8b78-d6a1e4ea430d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146342 May 16 17:22:16.760419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1484/2663] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:16 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:17.153879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:17.154495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:17.161390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:17.161866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:17.162630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:17.163067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:17.225199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:17.232943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-657ded8f-2820-4b03-864b-8d54e25c5373 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082978 May 16 17:22:17.233526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1180/2664] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:17.776461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:17.777004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:17.783347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:17.783796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:17.784560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:17.784998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:17.907116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:17.915402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3cc0150f-2340-4a05-b7dc-6587d718ee02 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.142882 May 16 17:22:17.915967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1485/2665] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:17 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:18.249802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:18.250412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:18.257236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:18.257682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:18.258476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:18.258912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:18.318444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:18.326135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8d3d85ca-c602-47bf-8f79-c274ead1b384 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080213 May 16 17:22:18.326700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1181/2666] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:18.932368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:18.932984 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:18.939781 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:18.940225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:18.940980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:18.941415 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:19.069121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:19.076796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7c16f6c9-3f49-4234-9974-c8b0949b19e1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148301 May 16 17:22:19.077366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1486/2667] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:19.343683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:19.344294 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:19.350829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:19.351280 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:19.352040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:19.352473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:19.413822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:19.421623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8d9f523a-1769-4350-8c55-60cd27998497 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081803 May 16 17:22:19.422218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1182/2668] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:20.095408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:20.096015 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:20.102435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:20.102878 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:20.103635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:20.104063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:20.232516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:20.240354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7a1d9d8f-63c9-4483-8bb5-7601f3270813 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149442 May 16 17:22:20.240916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1487/2669] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:20 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:20.438604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:20.439731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:20.449235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:20.449677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:20.450485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:20.450921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:20.518514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:20.526299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cbe2e54d-e76b-4006-8ba5-1ca06c45b63c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.091588 May 16 17:22:20.526864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1183/2670] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:21.256380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:21.256980 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:21.263267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:21.263714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:21.264470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:21.264915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:21.389635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:21.397498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f48daccf-cd09-41dc-b490-f9160c7e0319 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144984 May 16 17:22:21.398100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1488/2671] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:21 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:21.543407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:21.543970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:21.550952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:21.551404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:21.552184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:21.552618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:21.614704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:21.622391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a8a15ad4-e293-4208-9618-386d33b42bcd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082933 May 16 17:22:21.622954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1184/2672] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:22.415655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:22.415655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:22.421914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:22.422359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:22.423111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:22.423542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:22.551206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:22.558915 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a04fed35-0b5e-4ce0-9af5-edd5802fefff tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147742 May 16 17:22:22.559477 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1489/2673] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:22 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:22.639189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:22.639822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:22.646633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:22.647081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:22.647837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:22.648271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:22.709185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:22.716759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-024634ca-dc1a-48a4-965b-f2f30e4962a9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081434 May 16 17:22:22.717322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1185/2674] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:23.575300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:23.575856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:23.582989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:23.583438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:23.584190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:23.584623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:23.708292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:23.716003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d77dcac3-f2c7-49a9-a73b-5f71f132c971 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144654 May 16 17:22:23.716575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1490/2675] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:23.733319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:23.733979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:23.740805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:23.741239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:23.742023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:23.742493 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:23.801613 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:23.809237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e2ba1de-28b5-428f-9418-eb2bf242b9b4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079749 May 16 17:22:23.809822 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1186/2676] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:24.733708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:24.734290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:24.741061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:24.741511 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:24.742307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:24.742743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:24.826571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:24.827017 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:24.835524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:24.836195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:24.837061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:24.837495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:24.876903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:24.885594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cd1a7e92-be60-4938-b86f-c727c72c412f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155838 May 16 17:22:24.886205 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1491/2677] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:24 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:24.902397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:24.910640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-42bbd58b-626c-4e7d-966f-1b624eed6d99 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088390 May 16 17:22:24.911207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1187/2678] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:25.903211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:25.903945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:25.910752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:25.911207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:25.911978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:25.912418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:25.927942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:25.928552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:25.935104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:25.935555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:25.936319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:25.936758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:26.006725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:26.014376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-20c7c537-4eeb-42b8-9885-a428fcabfdfd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.090853 May 16 17:22:26.014946 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1188/2679] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:26.042759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:26.050579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-410402c0-3225-4e8a-9ee3-8dea66ae3f6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151267 May 16 17:22:26.051140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1492/2680] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:25 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:27.031921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:27.032538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:27.039469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:27.039914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:27.040688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:27.041125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:27.066929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:27.067487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:27.074112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:27.074560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:27.075328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:27.075759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:27.101063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:27.109088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5946e397-6666-4548-b342-8d012228730e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081057 May 16 17:22:27.109665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1189/2681] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:27.202292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:27.210870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-66f18bb8-2a98-4eed-be3d-9a1cebfe3d6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147825 May 16 17:22:27.211535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1493/2682] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:28.125864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:28.126476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:28.132866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:28.133315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:28.134096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:28.134531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:28.194185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:28.201792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cf2ecc89-36d9-4ba1-b33c-e95a6fbff723 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079768 May 16 17:22:28.202355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1190/2683] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:28.228253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:28.228870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:28.235128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:28.235574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:28.236333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:28.236771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:28.369445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:28.377279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cc8dd8fa-ff97-493d-8206-ace8cfa6978a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152759 May 16 17:22:28.377804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1494/2684] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:29.218477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:29.219031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:29.228725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:29.229172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:29.230182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:29.231467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:29.290742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:29.298267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e868511a-213e-49a7-b4da-c65658e320ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083853 May 16 17:22:29.298828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1191/2685] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:29.394116 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:29.394750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:29.400945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:29.401391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:29.402197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:29.402631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:29.528283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:29.536505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a5cd67c8-c248-4a9f-8902-4c95d939bdc9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146227 May 16 17:22:29.537064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1495/2686] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:29 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:30.316373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:30.317118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:30.323510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:30.323962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:30.324727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:30.325170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:30.388475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:30.396976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b11ac11a-7cc9-4e74-b754-ff5d6d702f1d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085128 May 16 17:22:30.397543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1192/2687] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:30.553886 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:30.554508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:30.560786 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:30.561240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:30.562040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:30.562482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:30.689451 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:30.697821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-96090245-3f48-4e37-b898-97a201c60d30 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148328 May 16 17:22:30.698390 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1496/2688] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:31.414798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:31.415865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:31.421763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:31.422222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:31.422991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:31.423432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:31.483106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:31.490831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-256fe252-c30c-4846-bd7d-a65be1091b6e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079906 May 16 17:22:31.491399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1193/2689] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:31.714321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:31.714942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:31.721227 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:31.721676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:31.722471 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:31.722913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:31.847160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:31.855360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-087b8bfc-d7db-43ba-ab82-e6e169e1205a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144955 May 16 17:22:31.856007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1497/2690] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:31 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:32.508148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:32.508766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:32.515264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:32.515714 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:32.516565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:32.517087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:32.577261 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:32.586119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3578d1d5-f7a5-496e-92b4-1ad6013d8666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081872 May 16 17:22:32.586679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1194/2691] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:32.871769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:32.872403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:32.879183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:32.879629 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:32.880409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:32.880811 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:33.004457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:33.012122 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-73bf2406-a806-4fa7-9de7-4d671a5856c3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144201 May 16 17:22:33.012685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1498/2692] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:32 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:33.603477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:33.604091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:33.610422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:33.610870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:33.611621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:33.612052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:33.672658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:33.680430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-25b05d81-6602-4244-8171-b4cb57cbe200 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080861 May 16 17:22:33.680994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1195/2693] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:34.029079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:34.029620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:34.035946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:34.036391 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:34.037148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:34.037581 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:34.166340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:34.174002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d4d32398-4334-492e-802b-b29c16a9ea39 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148859 May 16 17:22:34.174604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1499/2694] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:34 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:34.697288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:34.697876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:34.704162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:34.704611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:34.705371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:34.706661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:34.768109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:34.776458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b61053d5-3b00-4e7d-b727-babc22413f81 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083158 May 16 17:22:34.777025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1196/2695] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:34 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:35.191635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:35.192250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:35.198548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:35.198995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:35.199750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:35.200183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:35.323622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:35.331659 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e6425690-82e7-432c-b8e7-9eed822f5b98 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144279 May 16 17:22:35.332219 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1500/2696] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:35 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:35.792356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:35.792975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:35.799292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:35.799744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:35.800513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:35.800964 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:35.860897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:35.870503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-78a545ac-430c-4b9d-b4e1-926965d216d3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081937 May 16 17:22:35.871084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1197/2697] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:35 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:36.348521 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:36.349123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:36.355435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:36.355885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:36.356643 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:36.357080 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:36.487727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:36.495530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-362f27ce-18d4-4f02-8864-6a05c6b42917 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150920 May 16 17:22:36.496092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1501/2698] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:36 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:36.889138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:36.889777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:36.896329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:36.896784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:36.897551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:36.898022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:36.957243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:36.965355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6aec59e5-bb96-43a3-bb41-b272fc3ff6b0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080134 May 16 17:22:36.966019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1198/2699] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:37.513385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:37.514051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:37.520578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:37.521027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:37.521815 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:37.522254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:37.651941 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:37.660057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d2da6f88-d846-4698-a5bc-095cdea7b9ad tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150516 May 16 17:22:37.660625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1502/2700] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:37 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:37.983155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:37.983701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:37.990071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:37.990528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:37.991288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:37.991725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:38.051194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:38.058844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-604f65db-66da-448f-a391-2d2dd52eeab4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079646 May 16 17:22:38.059414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1199/2701] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:38.678100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:38.678658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:38.684905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:38.685351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:38.686140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:38.686577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:38.808332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:38.816108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-979d78a5-41bf-43a7-9319-e4f661bd0e9c tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.142742 May 16 17:22:38.816679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1503/2702] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:38 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:39.076451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:39.076993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:39.083588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:39.084041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:39.084816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:39.085283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:39.147734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:39.155502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-984ab67c-e435-4fb1-a309-4e52df47a98b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083041 May 16 17:22:39.156073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1200/2703] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:39.832574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:39.833215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:39.839479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:39.839923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:39.840678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:39.841110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:39.967320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:39.975597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-989b866f-2e48-4a63-a2f7-ffa954b51de1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147131 May 16 17:22:39.976161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1504/2704] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:39 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:40.172495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:40.173028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:40.180231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:40.180686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:40.181486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:40.181971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:40.243582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:40.251281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-55776f06-c9d4-4055-af10-5c64bd5b2a23 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082775 May 16 17:22:40.251856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1201/2705] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:40.993628 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:40.994271 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:41.000619 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:41.001070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:41.001858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:41.002299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:41.124828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:41.132545 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cf5b51cd-d31e-4315-a99b-3dc8c2025b56 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.142940 May 16 17:22:41.133117 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1505/2706] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:40 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:41.317631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:41.318345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:41.324688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:41.325196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:41.326048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:41.326521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:41.387495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:41.396157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d6a4be5b-227a-49e6-afab-f8db0ab8e4c1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.131911 May 16 17:22:41.396727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1202/2707] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:41 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:42.151123 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:42.151780 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:42.158103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:42.158554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:42.159317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:42.160260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:42.412954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:42.414521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:42.421567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:42.422077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:42.422863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:42.423301 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:42.486367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:42.494942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7dc083b2-c7f3-4510-88ed-c2722e3e95b5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085887 May 16 17:22:42.495558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1203/2708] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:42.545148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:42.553569 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bb5f02f7-cf0e-4de0-98a0-ddd45c597c45 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.406342 May 16 17:22:42.554178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1506/2709] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:42 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:43.512147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:43.512763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:43.519840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:43.520335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:43.521095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:43.521528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:43.570637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:43.571314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:43.577683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:43.578256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:43.579100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:43.579537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:43.585211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:43.592897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-38434833-d308-4c3e-9ff2-c6eeeb18904e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084574 May 16 17:22:43.593476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1204/2710] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:43.705174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:43.713709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2f597d0c-0530-4275-8570-f96b01974b6d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147020 May 16 17:22:43.714305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1507/2711] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:43 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:44.611678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:44.612300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:44.622187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:44.622641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:44.623417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:44.623867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:44.684793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:44.692667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-680f19d7-9a1d-4d3d-83ee-105445f294e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086193 May 16 17:22:44.693244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1205/2712] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:44.731359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:44.732044 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:44.739062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:44.739578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:44.740525 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:44.741040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:44.870045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:44.877634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-58f31d3f-f182-4d6b-ac38-9188720dbe36 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150594 May 16 17:22:44.878285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1508/2713] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:44 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:45.709889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:45.710512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:45.716474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:45.716960 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:45.717727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:45.718191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:45.781821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:45.789565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ed7912b7-036f-4ac6-97e8-05f7f368edb3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084012 May 16 17:22:45.790166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1206/2714] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:45.894757 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:45.895408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:45.901681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:45.902236 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:45.902999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:45.903437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:46.045152 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:46.053949 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f8697d13-af63-435e-934f-2909e3d7cbf3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.162992 May 16 17:22:46.054901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1509/2715] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:45 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:46.806561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:46.807154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:46.813404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:46.813895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:46.814669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:46.815107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:46.880441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:46.888424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8e1ecf1f-f960-43f6-bbe4-19e23e82c964 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085875 May 16 17:22:46.888999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1207/2716] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:47.072012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:47.072562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:47.078771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:47.079211 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:47.079967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:47.080398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:47.205078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:47.213068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3aeb5c48-e71b-48b1-b19e-1b6e9370dbfe tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.144977 May 16 17:22:47.213642 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1510/2717] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:47 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:47.905903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:47.906517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:47.914002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:47.914451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:47.915208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:47.915644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:47.981707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:47.989579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b491799c-679b-4daf-841d-e4511af95405 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087640 May 16 17:22:47.990187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1208/2718] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:48.229959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:48.230486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:48.236773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:48.237225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:48.238021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:48.238459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:48.364760 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:48.373651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-db91cd2c-23cf-4e71-b281-c26b2c36620f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147651 May 16 17:22:48.374259 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1511/2719] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:48 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:49.005716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:49.006340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:49.012752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:49.013199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:49.014003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:49.014443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:49.073119 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:49.080837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-645ceb41-157e-425c-94bd-483cf8fd1795 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.078955 May 16 17:22:49.081692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1209/2720] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:49.390874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:49.391484 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:49.398290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:49.398735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:49.399483 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:49.399914 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:49.529081 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:49.537418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9c100fa3-7a56-4d2e-b075-03db8f831141 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150486 May 16 17:22:49.538012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1512/2721] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:49 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:22:50.098524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:50.099185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:50.105442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:50.105931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:50.106689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:50.107130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:50.166372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:50.174179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-bc4f448e-e810-437f-963b-e83a784c27fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080172 May 16 17:22:50.174753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1210/2722] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:50.554583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:50.555378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:50.561552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:50.562035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:50.562796 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:50.563229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:50.694791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:50.702576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1fc5c482-ff75-4f4c-b362-442b2589dc4b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151913 May 16 17:22:50.703144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1513/2723] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:50 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:51.190283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:51.191420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:51.197720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:51.198197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:51.198984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:51.199409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:51.258924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:51.266689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b3380191-c0fb-4dae-a5de-7e88cd4c29ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080283 May 16 17:22:51.267265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1211/2724] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:51.720578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:51.721176 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:51.727517 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:51.727975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:51.728739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:51.729178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:51.858363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:51.866777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-efb7b5ea-1bba-47ab-b2a8-96ee25fa32cf tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150081 May 16 17:22:51.867354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1514/2725] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:51 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:52.283650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:52.284316 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:52.291194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:52.291644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:52.292404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:52.292839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:52.359302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:52.367083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dc772d22-580f-41b0-98b9-e04ea4b55986 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087321 May 16 17:22:52.367646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1212/2726] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:52.883795 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:52.884526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:52.890818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:52.891275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:52.892057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:52.892496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:53.024246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:53.032016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a34292fb-1ac1-4529-b80e-28d96022263a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152097 May 16 17:22:53.032573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1515/2727] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:52 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:53.383746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:53.384357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:53.390642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:53.391090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:53.391848 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:53.392278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:53.452285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:53.460352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4c139bed-95c4-435d-b33d-ae244f1d1cb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080462 May 16 17:22:53.460919 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1213/2728] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:54.048301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:54.048901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:54.055705 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:54.056153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:54.056912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:54.057345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:54.183305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:54.191034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a5ebb287-597d-4967-a41b-4a701b41f2c8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146600 May 16 17:22:54.191595 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1516/2729] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:54 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:54.478038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:54.478659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:54.484981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:54.485429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:54.486211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:54.486647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:54.546830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:54.554619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8cbb4d1a-01b8-4f24-930f-9d0964883375 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080399 May 16 17:22:54.555185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1214/2730] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:55.209198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:55.209822 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:55.216072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:55.216520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:55.217269 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:55.217702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:55.342682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:55.351627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e597004f-15bc-4546-9939-087e98f40a1f tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146608 May 16 17:22:55.351891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1517/2731] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:55 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:55.572049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:55.572620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:55.579003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:55.579453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:55.580216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:55.580654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:55.644405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:55.652209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-14e6ca50-430c-4b7c-bea3-0305b2a2ac6f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084160 May 16 17:22:55.652779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1215/2732] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:56.368237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:56.368897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:56.375163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:56.375604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:56.376358 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:56.376785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:56.504317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:56.512050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5d94cd77-2277-4d60-af77-f19c70be2590 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147709 May 16 17:22:56.512626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1518/2733] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:56 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:56.668480 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:56.669032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:56.675423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:56.675881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:56.676646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:56.677083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:56.740217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:56.748149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cdb81d1e-cd02-4b50-9f31-c08d886b91f2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083613 May 16 17:22:56.748727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1216/2734] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:57.531141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:57.531744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:57.538670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:57.539113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:57.539864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:57.540292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:57.666196 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:57.674912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-52d223b1-d9d1-4bb6-bb32-f265c2f0e125 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148173 May 16 17:22:57.675733 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1519/2735] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:57 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:57.764563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:57.765194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:57.772197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:57.772657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:57.773426 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:57.773901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:57.834477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:57.842227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fea7bcd6-2680-4ddc-a889-c7b2ed9249e5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081445 May 16 17:22:57.842803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1217/2736] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:58.692215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:58.692847 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:58.699169 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:58.699611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:58.700356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:58.700784 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:58.827314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:58.835238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9b377e73-08c1-4d44-b622-afb689d45fa6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146934 May 16 17:22:58.835806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1520/2737] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:58 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:58.859285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:58.859909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:58.866959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:58.867417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:58.868190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:58.868632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:58.929452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:58.937285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb653a71-20c7-448d-9f39-b9281b38ec34 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081896 May 16 17:22:58.937881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1218/2738] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:22:59.852625 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:59.853235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:59.859631 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:59.860111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:59.860873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:59.861307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:59.953731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:22:59.954456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:22:59.961172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:59.961635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:59.962467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:22:59.962911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:22:59.987460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:22:59.995753 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5ff252c2-4eb0-4e01-bbd9-f3234a8ad805 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146955 May 16 17:22:59.996337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1521/2739] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:59 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:00.024190 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:00.032155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9cd3ab16-d877-4a0b-a9a0-f2426d31c773 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082202 May 16 17:23:00.032736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1219/2740] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:22:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:01.013400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:01.014055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:01.020408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:01.020931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:01.021682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:01.022142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:01.048154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:01.048871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:01.055881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:01.056335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:01.057103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:01.057570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:01.120556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:01.128587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3cb20add-9612-456c-b29b-17ce8ac64bde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084148 May 16 17:23:01.129159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1220/2741] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:01.149128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:01.156823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-875a91e2-5340-44dc-b0f8-f0adb4b70628 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147245 May 16 17:23:01.157382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1522/2742] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:01 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:02.145151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:02.145926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:02.152178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:02.152628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:02.153390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:02.153843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:02.174132 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:02.175813 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:02.182228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:02.182765 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:02.183613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:02.184124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:02.222329 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:02.230465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-47af6e78-0615-48dd-af8d-66959b06e65d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.089610 May 16 17:23:02.231044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1221/2743] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:02.324043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:02.332197 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-97a8cf82-9d2d-4695-9e06-98efd4d449d9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.162060 May 16 17:23:02.332764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1523/2744] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:02 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:03.247659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:03.248265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:03.255295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:03.255743 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:03.256499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:03.256932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:03.316192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:03.324609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0a997683-7f17-4ff4-a075-5f63a52c0985 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080797 May 16 17:23:03.325184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1222/2745] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:03.348243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:03.348858 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:03.355178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:03.355623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:03.356381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:03.356814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:03.482246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:03.490492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3a5b661a-8835-491e-aa15-04ad043ed6eb tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146105 May 16 17:23:03.491058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1524/2746] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:03 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:04.342085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:04.342685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:04.349722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:04.350193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:04.354315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:04.354762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:04.415355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:04.423489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5d5461bb-23fd-400a-bf09-1e96f04736a8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085614 May 16 17:23:04.424054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1223/2747] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:04.506803 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:04.507422 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:04.513912 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:04.514364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:04.515131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:04.515568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:04.649124 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:04.657008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a96abc04-89dc-4eda-9a05-3b07fc23da28 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.154094 May 16 17:23:04.657571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1525/2748] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:04 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:05.440954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:05.441915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:05.449444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:05.450131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:05.451527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:05.452186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:05.518114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:05.526525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-58709ff9-9b0f-49a8-bdc2-5c0d1cf73214 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.090137 May 16 17:23:05.527097 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1224/2749] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:05.674170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:05.674790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:05.681620 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:05.682104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:05.682865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:05.683298 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:05.808258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:05.816118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17a62e40-5dbb-4df1-a81a-399db6345c1d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145834 May 16 17:23:05.816694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1526/2750] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:05 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:06.543892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:06.544409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:06.550675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:06.551650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:06.552404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:06.552832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:06.618208 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:06.626998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-29a65c8b-6260-458f-a869-d1dd05809c5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086915 May 16 17:23:06.627571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1225/2751] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:06.833241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:06.833892 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:06.840185 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:06.840636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:06.841400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:06.841868 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:06.971433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:06.979714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d9e3813c-6a13-4698-9b4a-cbdc0f8409a8 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.150619 May 16 17:23:06.980420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1527/2752] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:06 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:07.645372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:07.646015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:07.652344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:07.652827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:07.653598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:07.654070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:07.716326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:07.724147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-01bb093e-b992-4f02-8600-6fac37d90bd3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083399 May 16 17:23:07.724718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1226/2753] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:07 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:07.997455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:07.998030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:08.004917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:08.005363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:08.006143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:08.006572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:08.135913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:08.143535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5eec357c-6cf3-49b7-b151-4de40bc31360 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149975 May 16 17:23:08.144095 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1528/2754] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:07 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:08.740784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:08.741338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:08.747620 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:08.748073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:08.748826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:08.749262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:08.808331 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:08.816114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d2f087d1-84ba-4136-9d7c-5175def167e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079273 May 16 17:23:08.816692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1227/2755] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:09.161027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:09.161645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:09.167900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:09.168347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:09.169107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:09.169541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:09.304156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:09.312282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cdc51d3a-7acc-4fec-bdbf-0c4b0ba1bba5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.155756 May 16 17:23:09.312845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1529/2756] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:09 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:09.834769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:09.835427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:09.841769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:09.842218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:09.842979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:09.843418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:09.911121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:09.918843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cc47ca35-4c04-4450-913f-ae309e4df9e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088851 May 16 17:23:09.919412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1228/2757] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:10.331814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:10.332458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:10.339476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:10.340021 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:10.340809 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:10.341246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:10.477763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:10.487917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-112788e9-0f9b-4b82-bfb2-ad48aeb31f3d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.162213 May 16 17:23:10.488999 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1530/2758] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:10 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:10.935234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:10.935853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:10.942422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:10.942875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:10.943640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:10.944077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:11.004227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:11.012270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4dc8db71-ed2b-4a8e-835e-476a03c45973 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080998 May 16 17:23:11.012835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1229/2759] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:11.505121 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:11.505726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:11.512108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:11.512552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:11.513301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:11.513729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:11.639054 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:11.647246 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aa51f82e-3860-4803-8571-38cc4df97867 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146545 May 16 17:23:11.647806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1531/2760] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:11 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:12.029836 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:12.030394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:12.037286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:12.037758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:12.038531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:12.038975 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:12.098654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:12.106254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e546ee53-efae-42d2-a7ea-58a6176fe702 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080407 May 16 17:23:12.106826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1230/2761] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:12.664039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:12.664721 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:12.670946 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:12.671389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:12.672141 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:12.672570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:12.806392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:12.814094 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9022e32a-6c4c-406e-8543-4a02d02561ef tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153869 May 16 17:23:12.814823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1532/2762] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:12 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:13.123248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:13.123867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:13.130174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:13.130632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:13.131394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:13.131832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:13.191773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:13.199528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-04c4a6ab-ed56-4850-ac28-04d809dd188a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080118 May 16 17:23:13.200099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1231/2763] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:13.833061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:13.833693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:13.839948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:13.840389 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:13.841138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:13.841572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:13.967402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:13.975174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cde125bf-9b47-43d3-9f09-0e854fe08fd3 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146790 May 16 17:23:13.975737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1533/2764] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:13 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:14.217782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:14.218351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:14.224639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:14.225088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:14.225880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:14.226320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:14.288665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:14.296319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-71946cde-6081-4556-ab85-e71191d7ee43 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082544 May 16 17:23:14.296885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1232/2765] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:14.992342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:14.992942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:14.998861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:14.999301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:15.000059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:15.000486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:15.133255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:15.140992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-71444677-37a3-4f30-bea0-f16111ea84a7 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152695 May 16 17:23:15.141562 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1534/2766] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:14 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:15.313390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:15.313963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:15.320481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:15.320922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:15.321672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:15.322134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:15.388586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:15.397808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dd64b952-89ae-4319-afff-1216a6cfcce6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087875 May 16 17:23:15.404008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1233/2767] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:16.158608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:16.159364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:16.166365 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:16.166823 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:16.167592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:16.168033 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:16.294652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:16.302585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5b2782a9-a988-444c-a798-d5dfa4f584d6 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147884 May 16 17:23:16.303153 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1535/2768] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:16 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:16.415662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:16.416057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:16.422096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:16.422551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:16.423314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:16.423752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:16.483495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:16.491510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cda7607a-6604-41ab-9b30-3fd201b771a5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080802 May 16 17:23:16.492082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1234/2769] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:17.320137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:17.320864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:17.327202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:17.327650 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:17.328398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:17.328829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:17.455392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:17.464098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4fb4b7ed-42f2-4d76-8dc5-1ff2cd65b413 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148234 May 16 17:23:17.464658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1536/2770] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:17 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:17.508672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:17.509287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:17.515614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:17.516073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:17.516837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:17.517275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:17.578669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:17.587156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cb78a97a-5b85-4960-8a0a-521ef1dff836 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082858 May 16 17:23:17.587725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1235/2771] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:18.482215 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:18.482832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:18.489037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:18.489480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:18.490277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:18.490711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:18.552938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:23:18.553570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:23:18.608624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:18.609241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:18.615712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:18.616143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:18.616915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:18.617345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:18.623791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:18.631740 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e56c23db-2b6d-4698-89be-5571c4a7b58d tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153420 May 16 17:23:18.632314 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1537/2772] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:18 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:18.680742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:18.688901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d5830183-175a-4b2a-b358-4868d0b0c7ab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088850 May 16 17:23:18.689467 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1236/2773] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:18 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:19.649068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:19.649615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:19.656046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:19.656498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:19.657258 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:19.657691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:19.706074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:19.706699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:19.713793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:19.714262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:19.715057 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:19.715648 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:19.777204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:19.784997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8abafead-372d-4073-9e40-5b81bdc13399 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083027 May 16 17:23:19.785583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1237/2774] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:19.786045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:19.793962 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9336fced-27c9-4207-9cce-94a31cdde874 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.149368 May 16 17:23:19.794523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1538/2775] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:19 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:20.802312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:20.802863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:20.809193 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:20.809645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:20.810036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:20.810470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:20.810644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:20.810867 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:20.816825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:20.817263 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:20.818045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:20.818474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:20.871300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:20.879173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3ef11e8f-f439-400e-8f2c-fcf44b00cb37 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080833 May 16 17:23:20.879745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1238/2776] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:20.950777 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:20.958730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-98e41e1c-698d-4c49-9095-740de3fd4112 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152485 May 16 17:23:20.959289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1539/2777] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:20 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:21.896415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:21.897022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:21.903924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:21.904369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:21.905118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:21.905551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:21.966307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:21.974370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f281f6db-b6c9-4664-a373-ffc1fef027f5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081711 May 16 17:23:21.974944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1239/2778] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:21.975969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:21.976585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:21.982756 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:21.983200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:21.983952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:21.984377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:22.115243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:22.123494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-741a98ac-f63b-4ed1-8a56-5b2e30776cdc tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151313 May 16 17:23:22.124072 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1540/2779] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:21 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:22.991176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:22.992322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:22.998610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:22.999056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:22.999889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:23.000736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:23.063674 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:23.072255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-542377d5-0936-434d-937e-3bec1290e221 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085478 May 16 17:23:23.072831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1240/2780] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:23.140846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:23.141486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:23.147696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:23.148139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:23.148889 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:23.149335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:23.277674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:23.285392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-174bbe40-1103-4f53-87b6-c72ad035b2d5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148384 May 16 17:23:23.285992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1541/2781] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:23 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:24.089915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:24.090536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:24.096829 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:24.097276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:24.098062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:24.098501 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:24.159766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:24.167363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c51c17cc-e9b1-4b61-877c-b6976fcdd22d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081953 May 16 17:23:24.167932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1241/2782] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:24.302549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:24.303293 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:24.309653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:24.310131 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:24.310898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:24.311337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:24.437435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:24.445016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-25405bbf-3eaf-44db-9960-2a4f2900b4c0 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146523 May 16 17:23:24.445583 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1542/2783] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:24 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:25.184744 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:25.185352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:25.191583 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:25.192029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:25.192778 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:25.193205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:25.252761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:25.261122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1c1c3edc-c089-44a9-8424-28ed8735c285 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080234 May 16 17:23:25.261690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1242/2784] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:25.461513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:25.462076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:25.468350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:25.468789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:25.469537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:25.469992 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:25.595540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:25.603880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9ca2c84c-3329-489e-805e-4c28296bf42b tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146230 May 16 17:23:25.610341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1543/2785] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:25 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:26.278079 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:26.278682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:26.284998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:26.285453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:26.286246 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:26.286686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:26.346168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:26.354536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f8e9907-e6aa-4e84-952a-b0d158412505 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080398 May 16 17:23:26.355110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1243/2786] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:26.621839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:26.622462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:26.628701 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:26.629151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:26.629939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:26.630375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:26.768204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:26.776530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b37a4be3-6f1b-4202-a86a-2c5c5f4dcd44 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.158573 May 16 17:23:26.777103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1544/2787] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:26 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:27.371633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:27.372245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:27.378690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:27.379146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:27.379905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:27.380341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:27.442625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:27.450463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-299082e7-6457-4771-9f78-03b2bc567e7e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082776 May 16 17:23:27.451036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1244/2788] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:27.793624 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:27.794172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:27.800378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:27.800829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:27.801586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:27.802053 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:27.927754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:27.935495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cc6b12c9-ed44-425f-a1c8-9b301cff3428 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145775 May 16 17:23:27.936069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1545/2789] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:27 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:28.467477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:28.468094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:28.474451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:28.474903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:28.475666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:28.476977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:28.536207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:28.543967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0ccc937c-ee90-450b-a5fe-1e651430d4dc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080380 May 16 17:23:28.544538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1245/2790] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:28.952378 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:28.952989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:28.959600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:28.960048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:28.960799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:28.961238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:29.094723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:29.102315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f13c6de8-0bc7-4c6a-95c6-af6445d29ab1 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.153884 May 16 17:23:29.102884 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1546/2791] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:28 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:29.561184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:29.561817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:29.568084 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:29.568534 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:29.569289 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:29.569718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:29.628764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:29.636362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c316e75e-9682-461f-bfbd-245b118a4f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079053 May 16 17:23:29.636940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1246/2792] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:30.119161 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:30.119769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:30.126069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:30.126522 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:30.127277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:30.127709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:30.252157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:30.260308 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d1cdc1a9-a40f-4f38-b71d-eb09f86c45db tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145130 May 16 17:23:30.260880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1547/2793] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:30 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:30.653209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:30.653862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:30.660205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:30.660655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:30.661422 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:30.662062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:30.721492 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:30.729887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0c3a23ee-62c5-45b7-9b70-b50ce7ccaa04 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080592 May 16 17:23:30.730453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1247/2794] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:30 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:31.276968 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:31.277594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:31.283900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:31.284380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:31.285143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:31.285580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:31.409711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:31.418174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-429e325a-23c4-48ee-9aba-96aa8f10be78 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.145546 May 16 17:23:31.418737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1548/2795] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:31 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:31.751738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:31.752354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:31.759626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:31.760075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:31.760830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:31.761263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:31.825138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:31.833192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d817c5a1-e306-4a89-b081-9d2306737daf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085558 May 16 17:23:31.833783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1248/2796] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:32.435743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:32.436363 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:32.442761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:32.443214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:32.443981 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:32.444420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:32.572626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:32.580621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d71ee72-ddfd-4f08-945e-4461388f4d7a tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.148572 May 16 17:23:32.581224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1549/2797] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:32 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:32.851728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:32.852348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:32.858758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:32.859207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:32.859970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:32.860403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:32.920605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:32.928789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9f9525cf-51f2-4bb1-9581-1b82277ad6e7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081505 May 16 17:23:32.929361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1249/2798] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:33.598155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:33.598764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:33.605129 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:33.605573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:33.606464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:33.606939 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:33.732160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:33.740509 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f2bf6426-1085-402e-9eeb-4a7d21843da9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146439 May 16 17:23:33.741069 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1550/2799] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:33 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:33.945487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:33.946625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:33.953337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:33.953812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:33.954571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:33.955001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:34.014753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:34.022485 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-433b8c2d-afc2-4e9d-a3f5-74b5af0fdadf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080815 May 16 17:23:34.023048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1250/2800] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:34.757661 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:34.758277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:34.764516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:34.764966 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:34.765722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:34.766250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:34.898326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:34.906596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-70dd2351-21e0-4768-bb1b-98c5c0cc49c9 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.152945 May 16 17:23:34.907170 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1551/2801] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:34 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:35.038812 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:35.039352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:35.045981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:35.046432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:35.047191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:35.047624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:35.111573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:35.119266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0923fd63-6a7f-4825-8b3b-9877b820ebbd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084360 May 16 17:23:35.119828 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1251/2802] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:35 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:35.922506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:35.923120 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:35.929403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:35.929890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:35.930711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:35.931157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:36.058679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:36.066198 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-272e0bb1-a435-4ad9-9e60-72f020365d22 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.147564 May 16 17:23:36.066761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1552/2803] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:35 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:36.136295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:36.136911 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:36.143292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:36.143751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:36.144525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:36.144967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:36.207568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:36.215948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-99ce60c9-bc40-4eb4-9db5-ffffcec67c56 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083607 May 16 17:23:36.216545 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1252/2804] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:37.084228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:37.084866 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:37.091163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:37.091605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:37.092355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:37.092785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:37.223039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:37.231597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ba2d86aa-f616-4887-98ad-3bc5ddbde973 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.151473 May 16 17:23:37.232168 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1553/2805] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:37 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:37.232787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:37.233411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:37.240293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:37.240293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:37.241808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:37.241808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:37.302606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:37.310859 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8d35bfb5-f8de-4740-9c89-86e9e7c8a564 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081917 May 16 17:23:37.311424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1253/2806] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:38.248945 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:38.249576 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:38.255825 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:38.256275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:38.257031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:38.257468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:38.327961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:38.328664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:38.335288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:38.335735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:38.336494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:38.336933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:38.382919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:38.391330 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9b9ad317-e689-40fa-974e-fe40c8eb34e5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146237 May 16 17:23:38.391905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1554/2807] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:38 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:38.401925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:38.410269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae4fc4aa-48d2-43df-8a64-2bb9d38d67e4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.086083 May 16 17:23:38.410971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1254/2808] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:39.408413 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:39.409035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:39.415435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:39.415883 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:39.416653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:39.417089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:39.427014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:39.427624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:39.433924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:39.434379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:39.435147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:39.435587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:39.495795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:39.503749 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b4d9ee4e-c101-4306-896c-7f7986c907cc tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080632 May 16 17:23:39.504340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1255/2809] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:39.542951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:39.550726 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c450e841-7578-4c8b-8199-f8706f4098b2 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.146201 May 16 17:23:39.551302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1555/2810] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:39 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:40.520661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:40.521268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:40.528214 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:40.528660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:40.529417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:40.529874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:40.567664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:40.568387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] [instance: 38da705b-728f-449a-99ef-1428962695d3] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:40.575767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:40.576301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:40.577182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:40.577617 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:40.596435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:40.604067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-353696cb-5621-4035-9ec5-aaabdffd80a2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087252 May 16 17:23:40.604638 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1256/2811] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:40.716229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ab541e9017c4ece9432f1fedde0f64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07bcaeeb617491689c13594914b370e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:40.723074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5443589a-d3f0-4a2c-bf5a-347cb8bb5ad5 tempest-VolumesSnapshotTestJSON-1770920123 tempest-VolumesSnapshotTestJSON-1770920123-project] 10.222.0.70 "GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3" status: 200 len: 1559 microversion: 2.1 time: 0.159185 May 16 17:23:40.723675 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1556/2812] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:40 2022] GET /compute/v2.1/servers/38da705b-728f-449a-99ef-1428962695d3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:41.622187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:41.622762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:41.628977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:41.629429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:41.630335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:41.630781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:41.690923 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:41.699087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eb9ab2fc-442c-4d50-b97b-4221751be088 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080814 May 16 17:23:41.699656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1257/2813] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:41 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:42.716845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:42.717392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:42.723582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:42.724024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:42.724773 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:42.725203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:42.784938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:42.792807 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6abc41cc-cf72-43a4-959b-ca39c9ae2eab tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079919 May 16 17:23:42.793385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1557/2814] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:23:43.810305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:43.810861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:43.817410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:43.817906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:43.818675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:43.819115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:43.880262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:43.887924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6b3428f8-e153-4123-9eb1-0dea154a2c8e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082057 May 16 17:23:43.888488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1258/2815] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:44.905434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:44.906079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:44.912091 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:44.912541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:44.913300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:44.913758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:44.972998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:44.980498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-39ff5f35-2fdc-46bf-afe8-3638b78a8818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.078921 May 16 17:23:44.981099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1558/2816] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:45.996622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:45.997262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:46.003372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:46.003823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:46.004591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:46.005027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:46.064216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:46.072470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c4b2320f-5303-4d4f-9ff2-ba8876382243 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079740 May 16 17:23:46.073040 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1259/2817] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:47.093032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:47.093670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:47.100414 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:47.100859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:47.101611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:47.102071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:47.167079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:47.174924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9b6d4c94-59f5-46a9-9238-185e5cce1383 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085732 May 16 17:23:47.175496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1559/2818] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:48.192352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:48.192949 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:48.199362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:48.199810 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:48.200575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:48.201018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:48.264796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:48.272459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d15a2039-12eb-4dd5-9caa-b7eb1af2f09c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084015 May 16 17:23:48.273035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1260/2819] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:49.199708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:23:49.200416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:23:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:23:49.290048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:49.290652 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:49.297366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:49.297851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:49.298609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:49.299047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:49.358589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:49.366214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8d54c73f-0824-4670-aaf9-5086c6b9c91a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080090 May 16 17:23:49.366778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1560/2820] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:50.383628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:50.384240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:50.390567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:50.391350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:50.391768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:50.392202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:50.454663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:50.462632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-22f23ac1-d748-4d3f-9a23-cb33386b4826 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082853 May 16 17:23:50.463724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1261/2821] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:51.480439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:51.481049 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:51.487301 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:51.487743 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:51.488497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:51.488929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:51.549382 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:51.557499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-318d02d1-1e07-4286-883b-4916e7b0172e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080932 May 16 17:23:51.558102 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1561/2822] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:52.575018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:52.575637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:52.582258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:52.582718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:52.583482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:52.583916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:52.643652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:52.651531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3ae6762e-62d8-49e1-920a-e3dff802f127 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080920 May 16 17:23:52.652089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1262/2823] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:52 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:53.668917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:53.669490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:53.675655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:53.676100 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:53.676851 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:53.677281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:53.736585 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:53.744241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-52d95d26-3999-4daf-a3f3-da67cf169fd2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079762 May 16 17:23:53.746354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1562/2824] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:54.763419 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:54.763991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:54.770308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:54.770764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:54.771533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:54.771979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:54.832069 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:54.839799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f24c0a58-256c-4cc6-97b2-22c55082cbee tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081012 May 16 17:23:54.840384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1263/2825] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:55.856731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:55.857345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:55.863597 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:55.864039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:55.864790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:55.865223 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:55.927019 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:55.934859 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4f1d1e22-977e-417c-8e1d-beebc8991eb4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082128 May 16 17:23:55.935417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1563/2826] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:56.951793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:56.952386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:56.958799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:56.959251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:56.960006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:56.960436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:57.023797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:57.031525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9718714d-5e61-4be8-a0cf-07cceebca388 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083667 May 16 17:23:57.032113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1264/2827] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:58.049622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:58.050292 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:58.056526 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:58.057472 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:58.058262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:58.058696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:58.120316 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:58.128097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8f18f140-1ce1-4bd0-9f34-38d7977e667a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082328 May 16 17:23:58.128665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1564/2828] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:23:59.144605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:23:59.145220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:23:59.151695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:59.152145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:59.152896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:23:59.153328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:23:59.213528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:23:59.221760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2b351c02-611a-4a4e-bcb1-2f88ac5d4d87 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081002 May 16 17:23:59.222322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1265/2829] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:23:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:00.238682 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:00.239288 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:00.245593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:00.246077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:00.246837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:00.247270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:00.306656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:00.315028 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-af79995a-ffb6-4cb6-9b27-edbadaea7803 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080241 May 16 17:24:00.315607 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1565/2830] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:01.332837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:01.333601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:01.339926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:01.340430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:01.341264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:01.341834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:01.401853 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:01.409871 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d00a794a-a42f-4bca-ac0f-f5757a97554a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081299 May 16 17:24:01.410666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1266/2831] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:02.208036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:02.208575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:02.214881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:02.215329 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:02.216735 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:02.217177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:02.232420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 HTTP/1.1 May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:24:02.233996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.235425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'e21efdaa-3bbe-4f8b-953d-6baaaadb9b53'} May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:24:02.236385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.237714 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:02.239099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:24:02.239099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7c87a47c-c6d7-42f9-84a9-46a1365aba0b tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 404 len: 111 microversion: 2.1 time: 0.031418 May 16 17:24:02.239099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1566/2832] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:24:02 2022] DELETE /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:24:02.244013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:02.244627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] [instance: e21efdaa-3bbe-4f8b-953d-6baaaadb9b53] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:02.250516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:02.250969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:02.251728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:02.252172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:02.265727 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] HTTP exception thrown: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Request method failure captured: May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 HTTP/1.1 May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJMmDYj3q7jOvFnVM4aopvnBnmuQ8ZyID0isaGLlV9o2WddUbGgtCGLOXP5t5dfob0MWx-A5KI0KB6welj-gwMEi04-mDVubeG71v5a9ubzTblWO8OjjebuZ6YrXQvjVUIo3JExRtjITMfonUi0qKJMWwsn3PeeFT3kfLMiYlI4yQ8 May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 43c36b17e1414e208b453d10be94834c May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:24:02.267391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_43c36b17e1414e208b453d10be94834c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/43c36b17e1414e208b453d10be94834c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/43c36b17e1414e208b453d10be94834c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 43c36b17e1414e208b453d10be94834c May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2072566565 May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 13a6ce9b67564caab0892fc443073202 May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeNegativeTest-2072566565-project May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.269000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'e21efdaa-3bbe-4f8b-953d-6baaaadb9b53'} May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:24:02.269880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. May 16 17:24:02.271146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:02.272295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] Returning 404 to user: Instance e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:24:02.272295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2ed822fd-f9f0-4b40-ad19-b3983a9c7739 tempest-AttachVolumeNegativeTest-2072566565 tempest-AttachVolumeNegativeTest-2072566565-project] 10.222.0.70 "GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53" status: 404 len: 111 microversion: 2.1 time: 0.028541 May 16 17:24:02.272295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1267/2833] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:02 2022] GET /compute/v2.1/servers/e21efdaa-3bbe-4f8b-953d-6baaaadb9b53 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:24:02.427437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:02.428061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:02.435085 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:02.435457 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:02.436398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:02.436852 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:02.549800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:02.560409 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-944d7e93-0761-4d0a-8c10-f6f05c90c0df tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.135857 May 16 17:24:02.560715 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1567/2834] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:03.577530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:03.578178 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:03.584802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:03.585259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:03.586065 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:03.586508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:03.650892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:03.659436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a1a4c296-1ab4-4e90-959a-cfd436d32848 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085862 May 16 17:24:03.660022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1268/2835] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:04.320162 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-0426c2e8-3a64-44aa-be28-460e1ca7a026 req-6090df39-d2f6-48d6-8166-983f56f58711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384369a3-d514-4873-94eb-c7f9ffc45283", "name": "network-vif-deleted", "tag": "72814607-d40d-405f-923f-0e3b33277529"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:24:04.329527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-0426c2e8-3a64-44aa-be28-460e1ca7a026 req-6090df39-d2f6-48d6-8166-983f56f58711 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:04.330486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-0426c2e8-3a64-44aa-be28-460e1ca7a026 req-6090df39-d2f6-48d6-8166-983f56f58711 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:04.341668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-0426c2e8-3a64-44aa-be28-460e1ca7a026 req-6090df39-d2f6-48d6-8166-983f56f58711 service nova] Creating event network-vif-deleted:72814607-d40d-405f-923f-0e3b33277529 for instance 384369a3-d514-4873-94eb-c7f9ffc45283 on hv-cinder-83998 May 16 17:24:04.346742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-0426c2e8-3a64-44aa-be28-460e1ca7a026 req-6090df39-d2f6-48d6-8166-983f56f58711 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 May 16 17:24:04.347343 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1568/2836] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:24:04.679421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:04.680658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:04.692182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:04.692933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:04.693950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:04.694566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:04.798155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:04.806559 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1077cdb4-5715-470c-af2f-3603e4c05907 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.133754 May 16 17:24:04.807077 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1269/2837] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:05.824366 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:05.825759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:05.832017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:05.832469 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:05.833240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:05.834070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:05.911865 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:05.929337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fc3a3471-18a3-40d6-a0aa-c8799533f8ba tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.109474 May 16 17:24:05.942355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1569/2838] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:06.947195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:06.947950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:06.955442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:06.956142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:06.957088 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:06.958210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:07.024728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:07.033805 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b1fd07b6-ff7d-44f9-91de-a0bc6b5b949b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.090489 May 16 17:24:07.034413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1270/2839] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:07.138050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-24808d25-77be-47de-b0b2-b974af64cff7 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Action: 'create', calling method: .version_select at 0x7fead327d040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-155272950", "metadata": {"Type": "work"}}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-24808d25-77be-47de-b0b2-b974af64cff7 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 121 May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:24:07.153252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-155272950", "metadata": {"Type": "work"}}} May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 17:24:07.154926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-155272950', 'metadata': {'Type': 'work'}}}} May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise error May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi '#$%' May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:24:07.155924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 17:24:07.157677 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 17:24:07.159254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 17:24:07.159254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.159254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-24808d25-77be-47de-b0b2-b974af64cff7 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:24:07.159254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-24808d25-77be-47de-b0b2-b974af64cff7 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142725 May 16 17:24:07.159254 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1570/2840] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 16 17:24:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:24:07.164403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dec52a21-741d-47f1-9646-4088258d3b1a tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Action: 'create', calling method: .version_select at 0x7fead33ca0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-468926722", "metadata": {"Type": "work"}}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dec52a21-741d-47f1-9646-4088258d3b1a tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 119 May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:24:07.167726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-468926722", "metadata": {"Type": "work"}}} May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: May 16 17:24:07.169283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-468926722', 'metadata': {'Type': 'work'}}}} May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise error May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi '0' May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:24:07.170375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 17:24:07.171990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 17:24:07.173472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 17:24:07.173472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:24:07.173472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dec52a21-741d-47f1-9646-4088258d3b1a tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:24:07.173472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dec52a21-741d-47f1-9646-4088258d3b1a tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008532 May 16 17:24:07.173472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1271/2841] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 16 17:24:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:24:07.177934 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fd4ef8c-dd13-4cbb-a7fa-c6fe2d44e769 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Action: 'create', calling method: .version_select at 0x7feacd823550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2140031884", "metadata": {"Type": "work"}}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fd4ef8c-dd13-4cbb-a7fa-c6fe2d44e769 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 119 May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:24:07.180229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2140031884", "metadata": {"Type": "work"}}} May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 17:24:07.181839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2140031884', 'metadata': {'Type': 'work'}}}} May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise error May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi '' May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:24:07.182853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 17:24:07.185253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 17:24:07.186789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 17:24:07.186789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:24:07.186789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4fd4ef8c-dd13-4cbb-a7fa-c6fe2d44e769 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:24:07.186789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4fd4ef8c-dd13-4cbb-a7fa-c6fe2d44e769 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007516 May 16 17:24:07.186789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1571/2842] 10.222.0.70 () {60 vars in 1155 bytes} [Mon May 16 17:24:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:24:07.190495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75a9a3d0-018b-4539-b600-869a6c8dcc7c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7fead3427040>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:08.052470 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:08.053105 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:08.059508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:08.059953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:08.061261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:08.061708 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:08.122605 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:08.131047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-17222466-cdc2-43c2-b7e7-cda6bd199208 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083300 May 16 17:24:08.131618 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1572/2843] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:08 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:09.148071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:09.148771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:09.155683 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:09.156137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:09.156903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:09.157380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:09.216468 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:09.224764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1376caa7-cfb6-4c72-ae78-e40a58bd526b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080611 May 16 17:24:09.225339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1573/2844] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:09 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:10.242042 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:10.242744 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:10.249467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:10.249958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:10.250725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:10.251163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:10.313763 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:10.321441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-cf1cc3b6-c991-4d4c-bae3-2411da174aae tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083288 May 16 17:24:10.322035 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1574/2845] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:10 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:11.339144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:11.339839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:11.346107 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:11.346558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:11.347319 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:11.347762 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:11.410910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:11.418775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e2adf487-fbc0-407a-ad7b-9ccdb5b79fce tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083511 May 16 17:24:11.419346 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1575/2846] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:11 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:12.436125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:12.436829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:12.443179 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:12.443610 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:12.444368 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:12.444804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:12.511827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:12.519613 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0b75acb6-afd1-49eb-abf5-198692785140 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087395 May 16 17:24:12.520186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1576/2847] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:12 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:13.536430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:13.537051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:13.543294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:13.543738 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:13.545004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:13.545426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:13.606059 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:13.614313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9788873c-f163-479b-945f-d2c28104477d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081628 May 16 17:24:13.614812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1577/2848] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:13 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:14.631239 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:14.631898 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:14.637890 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:14.638948 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:14.639710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:14.640147 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:14.700871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:14.709283 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9bf1162d-e511-403e-b97c-8ca6e44c5d75 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081896 May 16 17:24:14.709874 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1578/2849] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:14 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:15.726533 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:15.727158 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:15.733302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:15.733764 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:15.734535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:15.734965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:15.794207 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:15.801961 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-32a2969d-514b-40f0-964d-498d0bfa2284 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079423 May 16 17:24:15.802528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1579/2850] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:15 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:16.819935 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:16.820600 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:16.827398 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:16.827861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:16.828632 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:16.829077 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:16.889772 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:16.897577 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fc00787c-786e-448f-afe4-4be286cd1fa0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081713 May 16 17:24:16.898174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1580/2851] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:16 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:17.914669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:17.915361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:17.921587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:17.922071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:17.922834 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:17.923270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:17.983348 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:17.990989 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f3e8008c-c636-4e6a-94b0-45d1187a5d6b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080239 May 16 17:24:17.991549 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1581/2852] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:17 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:19.008265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:19.009040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:19.015775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:19.016203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:19.016963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:19.017397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:19.078599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:19.086501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-88c4e7a7-893b-419f-9196-d049767c408b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082111 May 16 17:24:19.087067 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1582/2853] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:19 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:20.103266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:20.103976 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:20.111899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:20.112359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:20.113142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:20.113580 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:20.176032 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:20.183761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d4e76aa1-c251-4a14-8f92-63336127967a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084366 May 16 17:24:20.184325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1583/2854] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:20 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:21.201924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:21.202636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:21.209322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:21.209802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:21.210571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:21.211008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:21.271667 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:21.279260 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-26784ca1-2cf8-45b2-a293-eeeda003e90d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081899 May 16 17:24:21.279829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1584/2855] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:21 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:22.296155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:22.296861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:22.303086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:22.303540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:22.304324 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:22.304746 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:22.365037 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:22.373452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-41e24407-1ba3-4d6f-8a3d-3d23e7f32f5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080542 May 16 17:24:22.374058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1585/2856] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:22 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:23.391969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:23.392547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:23.398828 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:23.399284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:23.400047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:23.400480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:23.463228 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:23.471804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c2f0a599-97a2-49d8-98e7-403dffb2fdd7 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084175 May 16 17:24:23.472380 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1586/2857] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:23 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:24.489528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:24.490217 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:24.496487 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:24.496937 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:24.497689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:24.498144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:24.560749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:24.568537 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-accd7eb7-40e5-445f-aa65-205a59e2a456 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083081 May 16 17:24:24.569114 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1587/2858] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:24 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:25.585396 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:25.586099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:25.592983 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:25.593429 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:25.594221 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:25.594658 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:25.662359 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:25.670928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f0f53334-63ab-46e6-8a45-595efbcc9297 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.089414 May 16 17:24:25.671489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1588/2859] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:25 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:26.688214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:26.688876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:26.695086 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:26.695527 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:26.696279 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:26.696710 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:26.755638 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:26.763425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-83ee6fff-e1d4-48eb-a4db-34f58f08fe29 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079633 May 16 17:24:26.764648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1589/2860] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:26 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:27.782183 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:27.782832 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:27.788885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:27.789328 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:27.790112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:27.790548 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:27.857540 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:27.865947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a7fc08bb-8b3a-466a-b32a-860b99abebff tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088568 May 16 17:24:27.866558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1590/2861] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:27 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:28.884089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:28.884742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:28.890996 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:28.891459 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:28.892222 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:28.892664 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:28.960486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:28.968789 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0e9f478f-4583-4eac-8c00-0c3fa53425a3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088589 May 16 17:24:28.969361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1591/2862] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:28 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:29.985829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:29.986543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:29.992766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:29.993676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:29.994004 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:29.994653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:30.055518 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:30.064233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-80199392-5bd8-4594-b7f6-77dc0466fedf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082706 May 16 17:24:30.064802 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1592/2863] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:29 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:31.081150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:31.081879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:31.088047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:31.088494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:31.089262 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:31.089699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:31.148990 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:31.156680 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f50de570-2c98-4aac-a2ff-9c3fb5b102e3 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080209 May 16 17:24:31.157238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1593/2864] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:31 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:32.174064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:32.174739 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:32.180861 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:32.181303 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:32.182092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:32.182524 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:32.248040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:32.260846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f9618017-088e-41e9-b84a-2257b17fc376 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.091192 May 16 17:24:32.261427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1594/2865] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:32 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:33.278261 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:33.278947 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:33.285108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:33.285555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:33.286345 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:33.286778 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:33.350877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:33.358500 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-db55e1c7-4cee-422b-b4c2-54aceb872413 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084097 May 16 17:24:33.359057 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1595/2866] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:33 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:24:34.375893 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:34.376621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:34.382801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:34.383230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:34.383994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:34.384427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:34.445561 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:34.453334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0c780f73-c14c-4737-b8a8-55ae52933b4c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081844 May 16 17:24:34.453938 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1596/2867] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:34 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:35.470970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:35.471644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:35.477940 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:35.478426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:35.479190 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:35.479626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:35.539673 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:35.547860 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f92b76c1-3fc8-4838-8e02-926c2c1150d2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081321 May 16 17:24:35.548433 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1597/2868] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:35 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:36.565325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:36.566339 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:36.572722 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:36.573174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:36.573970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:36.574408 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:36.634827 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:36.642467 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-5576ae8c-8367-49ad-a85a-01477c19bb42 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081745 May 16 17:24:36.643036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1598/2869] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:36 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:37.659253 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:37.660024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:37.666240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:37.666689 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:37.667453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:37.667888 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:37.731534 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:37.739926 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2647def5-ff13-429c-a327-17427a92ddde tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084702 May 16 17:24:37.740493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1599/2870] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:37 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:38.757036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:38.757681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:38.763879 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:38.764322 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:38.765729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:38.766194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:38.832846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:38.840427 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7f1c37f7-b201-4529-b401-0df47a125755 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.087536 May 16 17:24:38.840991 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1600/2871] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:38 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:39.857155 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:39.857848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:39.864144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:39.864593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:39.865355 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:39.865821 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:39.928214 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:39.936232 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0e87aa72-9185-4846-84ad-8460f3c5a8d1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082942 May 16 17:24:39.936801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1601/2872] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:39 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:40.953482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:40.954464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:40.960790 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:40.961247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:40.962052 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:40.962496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:41.021785 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:41.029460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-89799efc-a6ea-41c3-bbac-db9ca2241ad6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079800 May 16 17:24:41.030065 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1602/2873] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:40 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:42.047299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:42.048501 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:42.055047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:42.055486 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:42.056338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:42.056891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:42.120352 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:42.128589 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4d06edc2-86da-4d30-a3cc-c372e78b28f4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085253 May 16 17:24:42.129151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1603/2874] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:42 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:43.144982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:43.145685 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:43.151833 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:43.152278 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:43.153029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:43.153458 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:43.212506 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:43.220284 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9c97c362-f2c5-4dac-93d7-90aaf5bf7578 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079793 May 16 17:24:43.220869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1604/2875] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:43 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:44.236871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:44.237573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:44.243783 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:44.244240 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:44.245001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:44.245436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:44.305331 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:44.312972 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-992d9df9-18c6-4d5f-8b09-2e4ba0e0ac93 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080514 May 16 17:24:44.314241 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1605/2876] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:44 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:45.331342 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:45.332079 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:45.337824 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:45.338264 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:45.339014 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:45.339441 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:45.401096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:45.410315 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4de4f544-1dc1-40aa-a945-47002d40cd8f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083185 May 16 17:24:45.411099 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1606/2877] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:45 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:46.427497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:46.428163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:46.434737 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:46.435187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:46.435942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:46.436371 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:46.499857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:46.508050 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2b5aaf46-2153-481c-b8a8-34b6f4c7ed62 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.084450 May 16 17:24:46.508767 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1607/2878] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:46 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:47.526118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:47.526723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:47.533062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:47.533508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:47.534311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:47.534749 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:47.600007 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:47.608093 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ef6ce01f-8cd2-4c6e-9474-31f8e4880ccd tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085819 May 16 17:24:47.608671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1608/2879] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:47 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:48.631901 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:48.632574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:48.639453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:48.639905 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:48.640671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:48.641109 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:48.699897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:48.708367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-593f9e1a-b1be-43a8-abc8-2053350283fe tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080904 May 16 17:24:48.708929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1609/2880] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:48 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:49.725656 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:49.726353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:49.732567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:49.733017 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:49.733808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:49.734255 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:49.794090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:49.801798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-58b6e916-68a0-4303-82f7-107d226c1b5f tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080754 May 16 17:24:49.802376 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1610/2881] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:49 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:50.818965 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:50.819603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:50.825829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:50.826281 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:50.827040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:50.827499 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:50.889752 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:50.897426 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-058331b6-d305-469d-8d93-dd6a88dd85eb tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082429 May 16 17:24:50.898039 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1611/2882] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:50 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:51.914416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:51.915106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:51.922113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:51.922559 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:51.923321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:51.923754 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:51.990882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:51.999126 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a3759abc-51aa-4f85-9d9b-2b0f09f0dcd6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.088537 May 16 17:24:51.999690 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1612/2883] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:51 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:53.016333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:53.017064 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:53.023662 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:53.024113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:53.024867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:53.025300 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:53.087247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:53.095047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-11ae93c8-6fa5-403b-af28-f124c54a2367 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082516 May 16 17:24:53.095621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1613/2884] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:53 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:54.112356 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:54.113051 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:54.119835 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:54.120277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:54.121024 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:54.121452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:54.181687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:54.189555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-8e97a86a-4e05-4bef-bdfb-c316c86dcb9b tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081066 May 16 17:24:54.190586 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1614/2885] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:54 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:55.207139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:55.207850 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:55.214008 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:55.214454 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:55.215204 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:55.215635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:55.280731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:55.288494 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-498dfb37-3357-4622-b454-ef79faba4cd1 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.085528 May 16 17:24:55.289061 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1615/2886] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:55 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:56.305060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:56.305793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:56.311953 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:56.312400 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:56.313186 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:56.313622 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:56.373320 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:56.380995 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1483c706-1b10-4ca5-b09b-89a29f02f847 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.079811 May 16 17:24:56.382142 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1616/2887] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:56 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:57.398060 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:57.398674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:57.405034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:57.405482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:57.406277 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:57.406712 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:57.466959 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:57.474564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-4991add7-0159-4d74-a5f5-ceabc6edafa9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081073 May 16 17:24:57.475130 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1617/2888] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:57 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:58.491332 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:58.491924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:58.498310 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:58.498761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:58.499516 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:58.499951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:58.559635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:58.567568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ad12f15f-e303-4f55-acd4-d0b4ac310872 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080154 May 16 17:24:58.568149 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1618/2889] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:58 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:24:59.585005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:24:59.585627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:24:59.591846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:59.592290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:59.593040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:24:59.593473 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:24:59.656555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:24:59.664774 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-7d468b8c-4a6f-44a9-a01b-bb17afd13b53 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083116 May 16 17:24:59.665337 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1619/2890] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:24:59 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:00.682256 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:00.682975 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:25:00.689137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:00.689582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:00.690369 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:00.690800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:00.750395 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:25:00.758768 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0ea89403-7ee9-4a42-b8bd-77d32dcdef45 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081071 May 16 17:25:00.759335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1620/2891] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:25:00 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:01.776925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:01.777552 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:25:01.783856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:01.784302 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:01.785115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:01.785492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:01.848799 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:25:01.856456 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0b423cde-4ccd-4f7b-8ba5-ffdafd3a380c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.083468 May 16 17:25:01.857034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1621/2892] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:25:01 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:02.873891 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:02.874592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:25:02.880759 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:02.881206 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:02.882001 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:02.882436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:02.942910 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:25:02.951294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-feae4e48-fe97-461c-a0c6-6ccb8a192b5e tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.081259 May 16 17:25:02.951868 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1622/2893] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:25:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:03.968800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:03.969502 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:25:03.975704 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:03.976151 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:03.976913 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:03.977351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:04.039709 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:25:04.047436 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-741c69ac-3540-4a49-9a63-22a56b2adacf tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.082411 May 16 17:25:04.048023 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1623/2894] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:25:03 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:05.065034 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:05.065806 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:25:05.071924 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:05.072370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:05.073125 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:05.073557 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:05.133257 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:25:05.141307 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-38657bd4-138d-45c1-9966-9f6631131e4d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.080101 May 16 17:25:05.141902 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1624/2895] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:25:05 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:05.392750 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:25:05.392929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:25:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:25:06.159323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:06.159963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:25:06.166282 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:06.166732 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:06.167523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:25:06.167951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:25:06.244103 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:25:06.252621 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bec2c8b7-22e2-4fa6-b169-b4745355af83 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.097108 May 16 17:25:06.253347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1625/2896] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:25:06 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:25:07.253046 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d3891954-ec7b-434c-ac2e-c1f30b3fe329 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feacf63e820>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:25:22.479588 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:25:22.480202 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:25:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-1829560630 (ip 10.222.0.70) !!! May 16 17:26:02.935684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-75a9a3d0-018b-4539-b600-869a6c8dcc7c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75a9a3d0-018b-4539-b600-869a6c8dcc7c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1829560630 HTTP/1.1 May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:26:02.938412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'tempest-invalid-1829560630'} May 16 17:26:02.940007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1829560630 could not be found. (HTTP 404) (Request-ID: req-2248039e-aa57-4aca-9249-f8308380e7ef) May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:02.941062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:26:02.942448 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:26:02.943732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75a9a3d0-018b-4539-b600-869a6c8dcc7c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume tempest-invalid-1829560630 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-75a9a3d0-018b-4539-b600-869a6c8dcc7c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1829560630" status: 404 len: 99 microversion: 2.1 time: 115.752968 May 16 17:26:02.945476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1272/2897] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 16 17:24:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1829560630 => generated 99 bytes in 115754 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 16 17:26:02.948349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:02.948349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:02.954821 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:02.955269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:02.956036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:02.956466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:03.032652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:03.032652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-be99cde0-d098-4398-a8ce-e71d686d38e6 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 200 len: 1369 microversion: 2.1 time: 0.091219 May 16 17:26:03.033150 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1273/2898] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:02 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:26:03.050033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-604a9fff-c85a-4091-9af6-e26af1e2c53d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '.version_select at 0x7fead33749d0>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:03.053213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR oslo.messaging._drivers.impl_rabbit [None req-604a9fff-c85a-4091-9af6-e26af1e2c53d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [04e66e42-5e22-41ec-bed7-cc8290ffd1f8] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 17:26:03.096881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-d3891954-ec7b-434c-ac2e-c1f30b3fe329 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d3891954-ec7b-434c-ac2e-c1f30b3fe329 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1829560630 HTTP/1.1 May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:26:03.099386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'tempest-invalid-1829560630'} May 16 17:26:03.100894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1829560630 could not be found. (HTTP 404) (Request-ID: req-48cdba2f-e671-42c4-a014-72cceab7c734) May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:03.101820 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:26:03.103495 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:26:03.104745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1829560630 could not be found. May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d3891954-ec7b-434c-ac2e-c1f30b3fe329 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume tempest-invalid-1829560630 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:26:03.106402 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d3891954-ec7b-434c-ac2e-c1f30b3fe329 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1829560630" status: 404 len: 99 microversion: 2.1 time: 55.851228 May 16 17:26:03.107958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1626/2899] 10.222.0.70 () {58 vars in 1217 bytes} [Mon May 16 17:25:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1829560630 => generated 99 bytes in 55858 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 16 17:26:03.111615 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:03.112112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:03.118846 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:03.119350 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:03.120119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:03.121575 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:03.147430 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:26:03.222528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-d5fdfd57-52fe-4d91-9adc-6b4158e1a840 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 204 len: 0 microversion: 2.1 time: 0.114254 May 16 17:26:03.223138 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1627/2900] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:26:03 2022] DELETE /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:26:03.228286 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-43a6ba7a-6ff5-4f8d-96e9-a3778588c5b1 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003936 May 16 17:26:03.228801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1628/2901] 10.222.0.70 () {58 vars in 1139 bytes} [Mon May 16 17:26:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 17:26:03.233265 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:03.234003 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:03.240192 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:03.240647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:03.241438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:03.241897 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:03.371766 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:03.379578 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b08a2e26-40a5-40ab-a89f-a64c5deb2fa0 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1508 microversion: 2.1 time: 0.149863 May 16 17:26:03.380144 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1629/2902] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:03 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:26:03.384691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-55f68f4d-d864-4d37-8b4c-f7fc89b86edc tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003486 May 16 17:26:03.385173 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1630/2903] 10.222.0.70 () {58 vars in 1136 bytes} [Mon May 16 17:26:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 17:26:03.393678 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1863372c-caab-4c54-9675-766ad867205c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feacdd03430>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:04.060738 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [None req-604a9fff-c85a-4091-9af6-e26af1e2c53d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [04e66e42-5e22-41ec-bed7-cc8290ffd1f8] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 45816. May 16 17:26:04.081764 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-604a9fff-c85a-4091-9af6-e26af1e2c53d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662303654" status: 202 len: 0 microversion: 2.1 time: 1.035539 May 16 17:26:04.082370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1274/2904] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 16 17:26:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662303654 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:26:04.396553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:04.397284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:04.403993 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:04.404457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:04.405269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:04.405935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:04.535165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:04.543781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c21649ad-1980-4a6e-bb82-20e00c12a4c7 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 200 len: 1508 microversion: 2.1 time: 0.151149 May 16 17:26:04.544646 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1275/2905] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:04 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:04.872790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-607d610b-71ff-406b-91be-f4622b115953 req-0ed2ebee-230e-45de-bad6-18d2753f65d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bded9a-8c44-4952-b4c6-77411db4c88b", "name": "network-vif-deleted", "tag": "1daf69b4-5c81-495d-8d47-d9a0bd00e8b4"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:04.888024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-607d610b-71ff-406b-91be-f4622b115953 req-0ed2ebee-230e-45de-bad6-18d2753f65d8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:04.888988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-607d610b-71ff-406b-91be-f4622b115953 req-0ed2ebee-230e-45de-bad6-18d2753f65d8 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:04.905699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-607d610b-71ff-406b-91be-f4622b115953 req-0ed2ebee-230e-45de-bad6-18d2753f65d8 service nova] Creating event network-vif-deleted:1daf69b4-5c81-495d-8d47-d9a0bd00e8b4 for instance d7bded9a-8c44-4952-b4c6-77411db4c88b on hv-cinder-83998 May 16 17:26:04.914962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-607d610b-71ff-406b-91be-f4622b115953 req-0ed2ebee-230e-45de-bad6-18d2753f65d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123592 May 16 17:26:04.916533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1276/2906] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:26:05.130924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5f2a7990-f0df-49b5-9b46-ca45e19f791d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'create', calling method: .version_select at 0x7feace098700>, body: {"keypair": {"name": "tempest-keypair-1766273344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEfCiQuPYzlHyIiIq8KXqWkmabXDpl2vTUdd2SdLA/BFk81R1gGRHDmksHsx/SSeyp++bHty5s9CruoH+R2NGRc4UHXbvfkEgRS5iqLIUs5Nd076Cui9ZuSLkqTLby50A=="}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:05.146893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-5f2a7990-f0df-49b5-9b46-ca45e19f791d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:26:05.151196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-5f2a7990-f0df-49b5-9b46-ca45e19f791d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for user 189966fbd18f4152b6b54ba5492034e0 and project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:26:05.181402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5f2a7990-f0df-49b5-9b46-ca45e19f791d tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054746 May 16 17:26:05.187560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1277/2907] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 17:26:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:26:05.561766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:05.562563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: d7bded9a-8c44-4952-b4c6-77411db4c88b] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:05.568772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:05.569231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:05.570033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:05.570505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:05.584604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] HTTP exception thrown: Instance d7bded9a-8c44-4952-b4c6-77411db4c88b could not be found. May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Request method failure captured: May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b HTTP/1.1 May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoKVrQRcYUG-VB_avmME8Bs8H7ZlGXfecyfltRxDOQzLqnt3OwRWzogIBKrh0Swq0gD7zHiCwuph7WGgsaJbjGOcgf5FrnXr16sjzCUzuDCD8SXuqcHdXLE14xP6cCmAFMrpF0GkblF5QUv8nk-gfefDO0J7rFtZ5XADpNHnEnmooMM May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: d288b61a6379415c9f773fc61950f570 May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-734861323 May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:26:05.586696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d288b61a6379415c9f773fc61950f570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d288b61a6379415c9f773fc61950f570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d288b61a6379415c9f773fc61950f570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d288b61a6379415c9f773fc61950f570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-ServerRescueNegativeTestJSON-734861323 May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: d288b61a6379415c9f773fc61950f570 May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-734861323 May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-ServerRescueNegativeTestJSON-734861323-project May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 673ff42fb9454adf93be94f46e60755a May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-ServerRescueNegativeTestJSON-734861323-project May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance d7bded9a-8c44-4952-b4c6-77411db4c88b could not be found. May 16 17:26:05.588570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'd7bded9a-8c44-4952-b4c6-77411db4c88b'} May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bded9a-8c44-4952-b4c6-77411db4c88b could not be found. May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:26:05.589953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bded9a-8c44-4952-b4c6-77411db4c88b could not be found. May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bded9a-8c44-4952-b4c6-77411db4c88b could not be found. May 16 17:26:05.591360 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:05.593974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Returning 404 to user: Instance d7bded9a-8c44-4952-b4c6-77411db4c88b could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:26:05.593974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6e7450be-7449-413c-8efc-2870d8678e1e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b" status: 404 len: 111 microversion: 2.1 time: 0.031450 May 16 17:26:05.593974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1278/2908] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:05 2022] GET /compute/v2.1/servers/d7bded9a-8c44-4952-b4c6-77411db4c88b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:26:05.597016 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:05.597511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:05.603652 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:05.604095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:05.604929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:05.606028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:05.632164 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:26:05.714782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5dfa931e-3ace-47ee-8649-e6a01dca7165 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "DELETE /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 204 len: 0 microversion: 2.1 time: 0.120652 May 16 17:26:05.715685 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1279/2909] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:26:05 2022] DELETE /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 17:26:05.726036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:05.726036 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:05.733260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:05.735699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:05.737099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:05.737099 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:06.038775 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:06.046747 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-16b8413d-d72d-42af-982e-57f101b4a3e5 tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1520 microversion: 2.1 time: 0.326641 May 16 17:26:06.047312 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1280/2910] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:05 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:07.009682 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-0d08ce6f-0b9d-441e-b4a3-5d0353ea5ab8 req-96732ed2-84f0-4b04-80ab-fb4ca962e50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511490fe-b0f9-40b5-ac21-4ca092e7e4ee", "name": "network-vif-deleted", "tag": "9478ec5c-7ce9-40dc-985e-b830b8e9bba3"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:07.022706 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0d08ce6f-0b9d-441e-b4a3-5d0353ea5ab8 req-96732ed2-84f0-4b04-80ab-fb4ca962e50d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:07.023155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0d08ce6f-0b9d-441e-b4a3-5d0353ea5ab8 req-96732ed2-84f0-4b04-80ab-fb4ca962e50d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:07.036766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-0d08ce6f-0b9d-441e-b4a3-5d0353ea5ab8 req-96732ed2-84f0-4b04-80ab-fb4ca962e50d service nova] Creating event network-vif-deleted:9478ec5c-7ce9-40dc-985e-b830b8e9bba3 for instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee on hv-cinder-83998 May 16 17:26:07.042295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-0d08ce6f-0b9d-441e-b4a3-5d0353ea5ab8 req-96732ed2-84f0-4b04-80ab-fb4ca962e50d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036264 May 16 17:26:07.043711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1281/2911] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:26:07.064359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:07.065278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:07.071841 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:07.072299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:07.073072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:07.073511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:07.138586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673ff42fb9454adf93be94f46e60755a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd288b61a6379415c9f773fc61950f570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:07.146464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a020fa2c-6683-44d4-bb2b-1b52e3ad897e tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 200 len: 1306 microversion: 2.1 time: 0.086324 May 16 17:26:07.147027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1282/2912] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:07 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:07.153116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-634494236", "imageRef": "92a92153-61bb-4c02-806a-20af08fa1dee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4e65cf1-f81c-4353-9c14-c2e64e36a512"}], "security_groups": [{"name": "tempest-securitygroup--318491881"}], "key_name": "tempest-keypair-1766273344", "user_data": "}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:07.254863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] validate_networks() for [('a4e65cf1-f81c-4353-9c14-c2e64e36a512', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:26:07.743612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:26:07.744035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:26:07.744507 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:26:07.744942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:26:07.745354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:26:07.755121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:07.755572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:07.756375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:07.756819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:07.772941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:26:07.777293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Getting quotas for user 189966fbd18f4152b6b54ba5492034e0 and project 59a45b25fa9e4a4bb9e144de365602bc. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:26:07.787891 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:26:07.790158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a92153-61bb-4c02-806a-20af08fa1dee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:26:07.838874 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c9ed3a0e-99c8-4978-a78d-5e02c6d8e00a tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.690835 May 16 17:26:07.840102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1283/2913] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:26:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:26:07.849731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-31629bce-759b-4fac-9e8c-48340ff8e45c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:07.850402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-31629bce-759b-4fac-9e8c-48340ff8e45c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:07.903988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-31629bce-759b-4fac-9e8c-48340ff8e45c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:07.910675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-31629bce-759b-4fac-9e8c-48340ff8e45c tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1237 microversion: 2.1 time: 0.064574 May 16 17:26:07.911346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1284/2914] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:07 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:08.163201 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:08.163912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] [instance: 511490fe-b0f9-40b5-ac21-4ca092e7e4ee] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:08.170342 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:08.170791 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:08.171553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:08.171986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:08.185290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] HTTP exception thrown: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee could not be found. May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Request method failure captured: May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee HTTP/1.1 May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoKVrQRcYUG-VB_avmME8Bs8H7ZlGXfecyfltRxDOQzLqnt3OwRWzogIBKrh0Swq0gD7zHiCwuph7WGgsaJbjGOcgf5FrnXr16sjzCUzuDCD8SXuqcHdXLE14xP6cCmAFMrpF0GkblF5QUv8nk-gfefDO0J7rFtZ5XADpNHnEnmooMM May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: d288b61a6379415c9f773fc61950f570 May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-734861323 May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:26:08.186939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d288b61a6379415c9f773fc61950f570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d288b61a6379415c9f773fc61950f570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d288b61a6379415c9f773fc61950f570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d288b61a6379415c9f773fc61950f570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-ServerRescueNegativeTestJSON-734861323 May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: d288b61a6379415c9f773fc61950f570 May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-734861323 May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-ServerRescueNegativeTestJSON-734861323-project May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 673ff42fb9454adf93be94f46e60755a May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-ServerRescueNegativeTestJSON-734861323-project May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee could not be found. May 16 17:26:08.188677 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '511490fe-b0f9-40b5-ac21-4ca092e7e4ee'} May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee could not be found. May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:26:08.194381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee could not be found. May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee could not be found. May 16 17:26:08.195956 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:26:08.197387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] Returning 404 to user: Instance 511490fe-b0f9-40b5-ac21-4ca092e7e4ee could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:26:08.197387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1579a48b-40ca-447c-b8e2-e5f6529b218b tempest-ServerRescueNegativeTestJSON-734861323 tempest-ServerRescueNegativeTestJSON-734861323-project] 10.222.0.70 "GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee" status: 404 len: 111 microversion: 2.1 time: 0.028986 May 16 17:26:08.197387 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1285/2915] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:08 2022] GET /compute/v2.1/servers/511490fe-b0f9-40b5-ac21-4ca092e7e4ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:26:08.929439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:08.930397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:08.937641 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:08.938132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:08.938902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:08.939334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:09.006176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:09.014680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-851decfa-f9fd-44f4-a47f-da10da723aa2 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1295 microversion: 2.1 time: 0.089151 May 16 17:26:09.015554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1286/2916] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:08 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:26:10.033548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:10.034321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:10.040635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:10.041082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:10.041881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:10.042816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:10.104456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:10.112882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e5595d15-b2b9-4e3d-9975-972c325b6fd5 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1295 microversion: 2.1 time: 0.084122 May 16 17:26:10.113458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1287/2917] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:10 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:11.130209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:11.130986 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:11.141857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:11.144129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:11.146892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:11.147633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:11.446527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:11.455520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-42897c60-177b-4d02-af17-be1cfcfaad30 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1362 microversion: 2.1 time: 0.329730 May 16 17:26:11.456999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1288/2918] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:11 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:11.465299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-0e685875-3a00-41bb-bf00-20f7beed7bd1 req-46a8f05e-b843-49a9-9479-4b38fa1a2b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc69ea91-91f3-4061-9537-3d7a6b8b08fe", "tag": "b632bcf6-62c7-49c6-bcd6-3461980f6e89"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:11.473983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0e685875-3a00-41bb-bf00-20f7beed7bd1 req-46a8f05e-b843-49a9-9479-4b38fa1a2b2e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:11.474765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-0e685875-3a00-41bb-bf00-20f7beed7bd1 req-46a8f05e-b843-49a9-9479-4b38fa1a2b2e service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:11.491553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-0e685875-3a00-41bb-bf00-20f7beed7bd1 req-46a8f05e-b843-49a9-9479-4b38fa1a2b2e service nova] Creating event network-changed:b632bcf6-62c7-49c6-bcd6-3461980f6e89 for instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe on hv-cinder-83998 May 16 17:26:11.507282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-0e685875-3a00-41bb-bf00-20f7beed7bd1 req-46a8f05e-b843-49a9-9479-4b38fa1a2b2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046882 May 16 17:26:11.507282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1289/2919] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:26:12.474901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:12.475630 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:12.481755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:12.482205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:12.482980 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:12.483420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:12.630517 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:12.638486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-96fa8fe1-c971-4b3c-a4c0-bdded65c8d57 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1362 microversion: 2.1 time: 0.168213 May 16 17:26:12.639236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1290/2920] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:12 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:13.655675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:13.656335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:13.662538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:13.662992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:13.663759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:13.664200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:13.857233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:13.871151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-47aaf211-43bf-48bd-8a70-2481d505f606 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1362 microversion: 2.1 time: 0.218944 May 16 17:26:13.871734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1291/2921] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:13 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:14.888721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:14.889341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:14.896181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:14.896742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:14.897395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:14.897861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:15.032353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:15.040308 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-68dd4da3-f54c-49c5-ab6b-45af3eb234d4 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1362 microversion: 2.1 time: 0.155897 May 16 17:26:15.041048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1292/2922] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:14 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:26:15.873835 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-5e777017-e682-43ac-9fe8-7742acf23cee req-b911534c-a354-462b-a4cd-31fc1e527005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69ea91-91f3-4061-9537-3d7a6b8b08fe", "name": "network-vif-plugged", "status": "completed", "tag": "b632bcf6-62c7-49c6-bcd6-3461980f6e89"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:15.882908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5e777017-e682-43ac-9fe8-7742acf23cee req-b911534c-a354-462b-a4cd-31fc1e527005 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:15.883354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5e777017-e682-43ac-9fe8-7742acf23cee req-b911534c-a354-462b-a4cd-31fc1e527005 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:15.894482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-5e777017-e682-43ac-9fe8-7742acf23cee req-b911534c-a354-462b-a4cd-31fc1e527005 service nova] Creating event network-vif-plugged:b632bcf6-62c7-49c6-bcd6-3461980f6e89 for instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe on hv-cinder-83998 May 16 17:26:15.899707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-5e777017-e682-43ac-9fe8-7742acf23cee req-b911534c-a354-462b-a4cd-31fc1e527005 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164367 May 16 17:26:15.900313 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1293/2923] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:26:16.056944 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:16.057961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:16.065389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:16.066365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:16.067394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:16.067941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:16.285135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:16.292437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2360b51d-2e10-4f15-806f-ef0745bf11c8 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1362 microversion: 2.1 time: 0.239637 May 16 17:26:16.293010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1294/2924] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:16 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:26:17.308809 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:17.309475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:17.315792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:17.316249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:17.317023 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:17.317479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:17.488566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:26:17.497203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-efef8e5e-f18d-4b18-8c70-77a7f49b0069 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1548 microversion: 2.1 time: 0.192357 May 16 17:26:17.497826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1295/2925] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:26:17 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:26:17.516752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:17.517347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:17.524410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:17.525347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:17.528443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:17.528996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:17.611015 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2370b471-897d-49f3-946d-3f40b42823fa tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098618 May 16 17:26:17.611608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1296/2926] 10.222.0.70 () {58 vars in 1274 bytes} [Mon May 16 17:26:17 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:26:18.664050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-5b025f63-9790-406e-8664-8f2e9a1ee153 req-048dd183-2c8e-4001-979e-3c05ef67ae67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc69ea91-91f3-4061-9537-3d7a6b8b08fe", "tag": "b632bcf6-62c7-49c6-bcd6-3461980f6e89"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:26:18.673121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5b025f63-9790-406e-8664-8f2e9a1ee153 req-048dd183-2c8e-4001-979e-3c05ef67ae67 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:18.673580 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-5b025f63-9790-406e-8664-8f2e9a1ee153 req-048dd183-2c8e-4001-979e-3c05ef67ae67 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:18.685626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-5b025f63-9790-406e-8664-8f2e9a1ee153 req-048dd183-2c8e-4001-979e-3c05ef67ae67 service nova] Creating event network-changed:b632bcf6-62c7-49c6-bcd6-3461980f6e89 for instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe on hv-cinder-83998 May 16 17:26:18.691081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-5b025f63-9790-406e-8664-8f2e9a1ee153 req-048dd183-2c8e-4001-979e-3c05ef67ae67 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159701 May 16 17:26:18.691907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1297/2927] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:26:54.402351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:26:54.403145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:26:54.414463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:54.414908 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:54.415687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:26:54.416123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:26:54.439553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-de7642e7-5b35-45eb-a6ba-b9ca53016818 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe/ips" status: 200 len: 145 microversion: 2.1 time: 0.042073 May 16 17:26:54.440124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1298/2928] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:26:54 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:27:03.454211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91568223-d568-408f-a51a-5a168713a12e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7fead3374160>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:03.341280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-1863372c-caab-4c54-9675-766ad867205c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1863372c-caab-4c54-9675-766ad867205c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f HTTP/1.1 May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:28:03.343445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '7e1ab98b-05e9-4a1d-8060-7614686a141f'} May 16 17:28:03.345238 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. (HTTP 404) (Request-ID: req-63848787-2f39-4f20-a14a-56acb7256d20) May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:03.346367 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:28:03.348323 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:28:03.349967 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-1863372c-caab-4c54-9675-766ad867205c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-1863372c-caab-4c54-9675-766ad867205c tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f" status: 404 len: 109 microversion: 2.1 time: 119.955025 May 16 17:28:03.351508 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1631/2929] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:26:03 2022] DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f => generated 109 bytes in 119956 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:28:03.470248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:03.470955 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:03.477542 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:03.478026 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:03.478931 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:03.479360 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:03.503418 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Going to try to terminate instance {{(pid=117184) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:28:03.584399 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e8161a19-59d6-4d7f-8ebd-54a4767e23c0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 204 len: 0 microversion: 2.1 time: 0.237035 May 16 17:28:03.585299 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1632/2930] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:28:03 2022] DELETE /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:28:03.590978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2e362b9b-2fa5-45a2-9968-cf1e2f89ff48 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feace57fca0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:03.881393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-91568223-d568-408f-a51a-5a168713a12e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91568223-d568-408f-a51a-5a168713a12e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f HTTP/1.1 May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:28:03.883508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '7e1ab98b-05e9-4a1d-8060-7614686a141f'} May 16 17:28:03.885293 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. (HTTP 404) (Request-ID: req-c527d9e3-a9c2-4951-8946-4abf8c84d497) May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:03.887875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:28:03.889573 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:28:03.892779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91568223-d568-408f-a51a-5a168713a12e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-91568223-d568-408f-a51a-5a168713a12e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f" status: 404 len: 109 microversion: 2.1 time: 60.434830 May 16 17:28:03.894525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1299/2931] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:27:03 2022] DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f => generated 109 bytes in 60436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:28:03.895774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:03.895774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:03.898955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:03.899410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:03.900175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:03.900616 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:04.033555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:04.041421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f69b2700-9dc5-4e2b-95c4-0cbf64b9fb86 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1672 microversion: 2.1 time: 0.154152 May 16 17:28:04.042021 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1300/2932] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:28:03 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:28:04.046941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:04.047486 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:04.052977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:04.053430 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:04.054227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:04.054666 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:04.080149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:28:04.125694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.compute.api [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Instance is already in deleting state, ignoring this request May 16 17:28:04.126554 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9f96299d-c57a-4a8a-b972-c4531b037560 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 204 len: 0 microversion: 2.20 time: 0.083627 May 16 17:28:04.127133 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1301/2933] 10.222.0.70 () {60 vars in 1279 bytes} [Mon May 16 17:28:04 2022] DELETE /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:28:04.134681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:04.135277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:04.140670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:04.141115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:04.141892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:04.142363 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:04.208239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:04.216275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:04.217786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:04.218918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ceb75721-e1e0-45a8-8d7c-198504bd72d6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087786 May 16 17:28:04.219469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1302/2934] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:05.060047 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:05.060740 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:05.066814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:05.067265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:05.068022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:05.068457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:05.198034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:05.205969 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-372926a1-1bac-4f70-bd22-8a7e84375686 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1672 microversion: 2.1 time: 0.150265 May 16 17:28:05.206538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1303/2935] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:28:05 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:28:05.237080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:05.237705 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:05.243558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:05.244038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:05.244816 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:05.245256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:05.305072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:05.313543 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:05.315210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:05.316365 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-691b2d70-e894-47f7-9e10-48090b21d544 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083420 May 16 17:28:05.317115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1304/2936] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:06.164110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-764a4e25-baa8-43b1-8900-c0e17f3b6b6a req-dbe45a60-cce4-4828-97a8-89cd265b32b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69ea91-91f3-4061-9537-3d7a6b8b08fe", "name": "network-vif-deleted", "tag": "b632bcf6-62c7-49c6-bcd6-3461980f6e89"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:28:06.175148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-764a4e25-baa8-43b1-8900-c0e17f3b6b6a req-dbe45a60-cce4-4828-97a8-89cd265b32b6 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:06.175604 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-764a4e25-baa8-43b1-8900-c0e17f3b6b6a req-dbe45a60-cce4-4828-97a8-89cd265b32b6 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:06.188592 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-764a4e25-baa8-43b1-8900-c0e17f3b6b6a req-dbe45a60-cce4-4828-97a8-89cd265b32b6 service nova] Creating event network-vif-deleted:b632bcf6-62c7-49c6-bcd6-3461980f6e89 for instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe on hv-cinder-83998 May 16 17:28:06.194572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-764a4e25-baa8-43b1-8900-c0e17f3b6b6a req-dbe45a60-cce4-4828-97a8-89cd265b32b6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 May 16 17:28:06.195174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1305/2937] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:28:06.224866 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:06.225578 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:06.233997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:06.234457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:06.235243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:06.235687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:06.305320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189966fbd18f4152b6b54ba5492034e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a45b25fa9e4a4bb9e144de365602bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:06.313436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9f3dbb4a-f415-4ca8-93ac-86c579aa5926 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 200 len: 1322 microversion: 2.1 time: 0.092800 May 16 17:28:06.314044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1306/2938] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:28:06 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:28:06.335106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:06.335721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:06.341719 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:06.342204 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:06.342981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:06.343417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:06.408415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:06.419429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:06.420925 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:06.422094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-34383434-9bea-4f93-b8e1-613b63ff1eec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.090845 May 16 17:28:06.422645 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1307/2939] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:07.330321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:07.331013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:07.337255 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:07.337704 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:07.338499 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:07.338937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:07.351850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] HTTP exception thrown: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Request method failure captured: May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe HTTP/1.1 May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJRyCdr02Qdnm-CiAQNNbE-zaX4uOdJA_-jKYs_NxSxnWqpeGOWOO_Tm1isBIxRzVV8bYiXuNcTyzaKYoW9wWJYT6N2STMggEn3HCE9-TrIdIyUDkoJJkh4ayGr2aK8VvMW0DQAdudPATFdOo1iVa9lMtJYT_4h3zEwPP6hItA9GzM May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:28:07.353484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 189966fbd18f4152b6b54ba5492034e0 May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:07.355300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'dc69ea91-91f3-4061-9537-3d7a6b8b08fe'} May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:28:07.359413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:07.361089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:07.362624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Returning 404 to user: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:28:07.362624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9834f56c-fd4d-4581-89b3-5a48a9e08352 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 404 len: 111 microversion: 2.1 time: 0.028661 May 16 17:28:07.362624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1308/2940] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:28:07 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:28:07.363307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4f214454-b7e0-4c03-9576-d9792ddd0fb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '.version_select at 0x7feace29dca0>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:07.380761 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4f214454-b7e0-4c03-9576-d9792ddd0fb0 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766273344" status: 202 len: 0 microversion: 2.1 time: 0.021069 May 16 17:28:07.381314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1309/2941] 10.222.0.70 () {58 vars in 1220 bytes} [Mon May 16 17:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766273344 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:28:07.440505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:07.441120 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:07.447386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:07.447843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:07.448632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:07.449074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:07.706814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:07.716102 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:07.717609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:07.718802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e67297ea-34de-4623-bc3b-9b4dbb1b0ad2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.282318 May 16 17:28:07.719359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1310/2942] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:08.265550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:08.266134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:08.271940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:08.272392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:08.273163 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:08.273661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:08.286286 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] HTTP exception thrown: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Request method failure captured: May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe HTTP/1.1 May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJRyCdr02Qdnm-CiAQNNbE-zaX4uOdJA_-jKYs_NxSxnWqpeGOWOO_Tm1isBIxRzVV8bYiXuNcTyzaKYoW9wWJYT6N2STMggEn3HCE9-TrIdIyUDkoJJkh4ayGr2aK8VvMW0DQAdudPATFdOo1iVa9lMtJYT_4h3zEwPP6hItA9GzM May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:28:08.287808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 189966fbd18f4152b6b54ba5492034e0 May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.289510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'dc69ea91-91f3-4061-9537-3d7a6b8b08fe'} May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:28:08.290533 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.292125 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.293770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Returning 404 to user: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:28:08.293770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d6e964f8-0651-4b2f-984f-ef833ed67558 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 404 len: 111 microversion: 2.1 time: 0.028093 May 16 17:28:08.293770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1311/2943] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:28:08 2022] DELETE /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:28:08.297114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:08.297724 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: dc69ea91-91f3-4061-9537-3d7a6b8b08fe] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:08.303249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:08.303709 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:08.304470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:08.304913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:08.318618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] HTTP exception thrown: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Request method failure captured: May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe HTTP/1.1 May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJRyCdr02Qdnm-CiAQNNbE-zaX4uOdJA_-jKYs_NxSxnWqpeGOWOO_Tm1isBIxRzVV8bYiXuNcTyzaKYoW9wWJYT6N2STMggEn3HCE9-TrIdIyUDkoJJkh4ayGr2aK8VvMW0DQAdudPATFdOo1iVa9lMtJYT_4h3zEwPP6hItA9GzM May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:28:08.320107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 189966fbd18f4152b6b54ba5492034e0 May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.321883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'dc69ea91-91f3-4061-9537-3d7a6b8b08fe'} May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:28:08.322844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. May 16 17:28:08.325048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:28:08.326793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Returning 404 to user: Instance dc69ea91-91f3-4061-9537-3d7a6b8b08fe could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:28:08.326793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b18c3e44-f5ba-4801-9658-65f7811e2471 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe" status: 404 len: 111 microversion: 2.1 time: 0.027893 May 16 17:28:08.326793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1312/2944] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:28:08 2022] GET /compute/v2.1/servers/dc69ea91-91f3-4061-9537-3d7a6b8b08fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:28:08.738735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:08.739406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:08.745766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:08.746856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:08.747629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:08.748072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:08.810146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:08.818366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:08.819872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:08.821014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9a0c0a64-8cb5-4c93-9102-8666cce07a17 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086232 May 16 17:28:08.821569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1313/2945] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:09.838785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:09.839471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:09.846408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:09.846869 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:09.847635 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:09.848075 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:09.907352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:09.915525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:09.917031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:09.918842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2dda7209-da49-41f5-a3e7-849b71315647 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083349 May 16 17:28:09.919391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1314/2946] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:09 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:10.936404 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:10.937107 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:10.943375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:10.943833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:10.944605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:10.945049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:11.006907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:11.015489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:11.016979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:11.018134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-87e9754e-b11b-4129-9f9c-73c6a888cb82 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085664 May 16 17:28:11.018688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1315/2947] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:12.036349 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:12.037034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:12.043311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:12.043768 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:12.044537 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:12.044994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:12.104446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:12.112615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:12.114166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:12.115307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-692284c8-0a60-4a14-89c5-ae421a4e3a1b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082883 May 16 17:28:12.115892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1316/2948] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:13.133608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:13.134402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:13.140526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:13.140973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:13.141728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:13.142211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:13.203563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:13.211707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:13.213220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:13.214378 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2f984a79-523a-4598-b402-1e974608806e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084719 May 16 17:28:13.215089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1317/2949] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:14.232237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:14.232934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:14.239130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:14.239576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:14.240328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:14.240756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:14.302636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:14.311231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:14.312713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:14.313873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ebcab12e-261d-4c34-92fa-95f3eb3a388a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085520 May 16 17:28:14.314408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1318/2950] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:15.331563 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:15.332267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:15.338114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:15.338568 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:15.339328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:15.340390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:15.399014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:15.408091 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:15.409601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:15.410783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8b74f77e-fab0-42ce-8fb1-c18d264122ab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083326 May 16 17:28:15.411348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1319/2951] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:16.428472 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:16.429090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:16.435954 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:16.436409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:16.437174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:16.439087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:16.500505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:16.508660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:16.510202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:16.511350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e99ad332-7b43-4142-b26f-39e22eab0982 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086863 May 16 17:28:16.512520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1320/2952] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:17.529683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:17.530328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:17.536692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:17.537146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:17.537952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:17.538397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:17.600864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:17.609345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:17.610905 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:17.612058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c1e01bcd-f13d-4726-b5aa-b0b9ea9e494c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086949 May 16 17:28:17.612619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1321/2953] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:18.563730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 16 17:28:18.564354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:28:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:28:18.629715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:18.630347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:18.637259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:18.637712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:18.638504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:18.638940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:18.701814 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:18.709979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:18.711479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:18.712617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9f71398f-dcc8-4cac-9f5f-d7012f1d593b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086769 May 16 17:28:18.713166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1322/2954] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:19.731226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:19.731876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:19.738117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:19.738574 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:19.739340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:19.739785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:19.801221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:19.810095 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:19.811595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:19.812731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-794da78f-e909-4470-ab62-9d5346265481 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086097 May 16 17:28:19.813287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1323/2955] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:20.830842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:20.831505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:20.837799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:20.838254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:20.839027 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:20.839464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:20.900691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:20.908782 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:20.910325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:20.911459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-32a53d82-076d-424b-9824-eebe5837a09f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084570 May 16 17:28:20.912008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1324/2956] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:20 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:21.929118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:21.929861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:21.936043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:21.936494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:21.937257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:21.937699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:21.996697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:22.004953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:22.006487 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:22.007622 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1b6cd33b-af78-417f-8d1b-f13e801057a2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082496 May 16 17:28:22.008181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1325/2957] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:23.025774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:23.026454 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:23.033242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:23.033695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:23.034484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:23.034918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:23.100901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:23.109336 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:23.110851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:23.112001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-50c7b1d7-cc22-43d6-995d-a01ff667ffb1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.090224 May 16 17:28:23.112558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1326/2958] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:24.130356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:24.131056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:24.137270 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:24.137722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:24.138511 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:24.138947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:24.198721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:24.207699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:24.209199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:24.210366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9eb45f53-b24a-45c6-9692-83cfa10552b3 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083926 May 16 17:28:24.210914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1327/2959] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:25.228500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:25.229206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:25.235900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:25.236348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:25.237113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:25.237548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:25.296755 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:25.304827 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:25.306361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:25.307502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-731a2548-a481-410e-b65c-04a93c20f401 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082959 May 16 17:28:25.308054 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1328/2960] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:25.402250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:28:25.403280 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:28:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f (ip 10.222.0.70) !!! May 16 17:28:26.326194 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:26.326808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:26.333085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:26.333531 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:26.334318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:26.334752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:26.393576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:26.401625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:26.403175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:26.404300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e6cd4584-d0c0-4507-8936-2f821b4a8700 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082898 May 16 17:28:26.404849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1329/2961] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:27.424519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:27.425170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:27.431532 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:27.431987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:27.432752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:27.433187 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:27.496082 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:27.504383 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:27.505914 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:27.507048 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4c4dfb7b-7479-4751-81c9-d52e877a6d48 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086559 May 16 17:28:27.507608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1330/2962] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:28.525421 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:28.526144 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:28.532943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:28.533396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:28.534192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:28.534629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:28.596287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:28.604561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:28.606585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:28.607722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ae142048-5765-4d5d-9606-1406fc6bc189 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086222 May 16 17:28:28.608290 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1331/2963] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:29.625781 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:29.626456 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:29.632723 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:29.633175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:29.633965 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:29.634409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:29.693659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:29.702093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:29.703597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:29.704730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d716f46a-d3d5-438f-a54a-e2f85a491638 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083423 May 16 17:28:29.705283 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1332/2964] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:28:30.722500 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:30.723172 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:30.729402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:30.729889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:30.730665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:30.731110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:30.790776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:30.799013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:30.800526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:30.801676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ef16ecc9-3167-4c4b-b822-b3e5dba6b4f9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083231 May 16 17:28:30.802276 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1333/2965] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:30 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:31.819989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:31.820605 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:31.827158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:31.827610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:31.828380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:31.828817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:31.892411 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:31.902656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:31.904207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:31.905354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4fb7775b-262a-46f3-ae84-712308a923dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.089340 May 16 17:28:31.905934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1334/2966] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:32.922373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:32.923699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:32.930171 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:32.930626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:32.931395 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:32.931832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:32.991424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:32.999443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:33.000950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:33.002121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5c51a4ff-df13-4cbe-a3ae-d39896910765 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083672 May 16 17:28:33.002679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1335/2967] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:34.020465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:34.021161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:34.027386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:34.027865 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:34.028625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:34.029684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:34.089240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:34.098177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:34.099692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:34.100833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-25b4af6d-a134-4bca-8925-d4b2579b02e8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084324 May 16 17:28:34.101388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1336/2968] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:35.118582 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:35.119357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:35.125695 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:35.126209 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:35.126971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:35.127406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:35.189265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:35.197403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:35.198938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:35.200074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-94f664b6-67fb-49ba-b7c2-767284405bf5 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085421 May 16 17:28:35.200898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1337/2969] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:36.218179 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:36.218883 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:36.225052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:36.225504 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:36.226298 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:36.226737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:36.288955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:36.304073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:36.305662 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:36.306873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e94037d0-dad3-440e-83f5-56a1f2929ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.092597 May 16 17:28:36.307431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1338/2970] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:37.325701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:37.326350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:37.332667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:37.333118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:37.333921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:37.334359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:37.394271 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:37.402352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:37.404346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:37.405516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-067b3917-42ba-4f0b-9c9e-961db2ee9a15 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084319 May 16 17:28:37.406108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1339/2971] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:38.424941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:38.425732 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:38.432978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:38.433428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:38.434218 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:38.434650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:38.494142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:38.502843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:38.504330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:38.505460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9662877d-05fa-4af7-8fc9-3db270e5c5c4 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086207 May 16 17:28:38.506051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1340/2972] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:39.523262 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:39.523857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:39.530837 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:39.531291 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:39.532053 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:39.532488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:39.592900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:39.601123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:39.602660 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:39.603804 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cbe02839-707b-4094-8fdd-7136200a5cec tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084443 May 16 17:28:39.604354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1341/2973] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:40.622034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:40.622850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:40.629018 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:40.629473 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:40.630277 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:40.630729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:40.693602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:40.702721 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:40.704230 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:40.705376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e59e05e-7bc0-4e55-b2c7-8a85be9cf136 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087292 May 16 17:28:40.705961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1342/2974] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:41.723386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:41.724043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:41.730192 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:41.730642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:41.731400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:41.732482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:41.791895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:41.799962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:41.801453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:41.802618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-71903482-2745-4aa0-93c9-531410d0bc6b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083223 May 16 17:28:41.803173 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1343/2975] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:42.487560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:28:42.488010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:28:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f (ip 10.222.0.70) !!! May 16 17:28:42.820393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:42.820972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:42.827469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:42.827910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:42.828668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:42.829101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:42.889950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:42.897948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:42.899437 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:42.900555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1d67d0ba-2c8f-40ec-86a3-aafb9ce6eba1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084147 May 16 17:28:42.901116 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1344/2976] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:43.919181 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:43.920431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:43.926650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:43.927103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:43.928210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:43.928642 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:43.991771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:43.999984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:44.001481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:44.002650 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f324cac6-05ee-4b51-b04b-57421a36d2b2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087329 May 16 17:28:44.003217 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1345/2977] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:45.020897 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:45.021600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:45.027896 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:45.028420 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:45.029918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:45.030359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:45.092912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:45.100948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:45.102494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:45.103628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3abe8f90-b02c-4012-a494-674bc615782d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087331 May 16 17:28:45.104174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1346/2978] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:46.120375 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:46.121089 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:46.127282 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:46.127736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:46.128502 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:46.128937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:46.191129 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:46.199587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:46.201447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:46.202629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ad5275da-dec5-4716-ba05-1c8cdeb94fb2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086146 May 16 17:28:46.203196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1347/2979] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:47.220571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:47.221275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:47.227466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:47.227918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:47.228676 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:47.229117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:47.288725 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:47.297273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:47.298795 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:47.299918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7f69f58f-7475-49ab-ba65-11e889738b26 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083259 May 16 17:28:47.300468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1348/2980] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:48.318634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:48.319341 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:48.325769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:48.326226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:48.326978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:48.327408 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:48.386538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:48.395524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:48.397105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:48.398667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-26f4679f-65b7-4f03-a9cf-9a89b7ca8e99 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083832 May 16 17:28:48.399285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1349/2981] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:49.416544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:49.417155 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:49.423982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:49.424431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:49.425186 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:49.425621 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:49.488728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:49.496922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:49.499111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:49.500248 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3945896e-bde3-4dbc-b71e-7b8cc8b44604 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087574 May 16 17:28:49.500803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1350/2982] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:50.518402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:50.519062 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:50.525254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:50.525700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:50.526484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:50.526915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:50.589287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:50.597476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:50.599009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:50.600146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-279e8e97-1caa-4eaf-bb91-940e4fc93435 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085603 May 16 17:28:50.600713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1351/2983] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:51.618035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:51.618654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:51.624987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:51.625444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:51.626243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:51.626690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:51.686948 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:51.695182 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:51.696692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:51.697863 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b1a1b209-ee1a-4fdf-98a6-27b14996e990 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083732 May 16 17:28:51.698429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1352/2984] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:52.716435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:52.717111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:52.723258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:52.723713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:52.724475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:52.724918 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:52.784033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:52.792180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:52.793684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:52.794851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-71bf6dad-c61e-4d7a-9870-601729c337ef tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082411 May 16 17:28:52.795423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1353/2985] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:52 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:53.813292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:53.814024 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:53.820141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:53.820591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:53.821347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:53.821826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:53.884009 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:53.892250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:53.893731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:53.894885 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-35955cd1-9d0b-4531-87b2-d56a2ac0bf69 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086151 May 16 17:28:53.895438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1354/2986] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:54.916906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:54.917675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:54.924470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:54.924920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:54.925681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:54.926152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:54.986215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:54.994433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:54.995913 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:54.997044 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7baffc5f-1926-417b-8ba1-24b6d4fbd9db tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085922 May 16 17:28:54.997633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1355/2987] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:56.014917 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:56.015631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:56.021978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:56.022435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:56.023212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:56.023653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:56.084544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:56.092711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:56.094254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:56.095392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-761929a2-940d-4220-915b-c0e2ec46ff7e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085158 May 16 17:28:56.095952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1356/2988] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:57.112998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:57.113664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:57.119912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:57.120361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:57.121124 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:57.121561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:57.183352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:57.191496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:57.192991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:57.194159 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-78dbfee6-4dc4-43e7-9738-f6b8706c30b1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085073 May 16 17:28:57.194722 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1357/2989] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:58.212127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:58.212831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:58.219571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:58.220019 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:58.220774 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:58.221234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:58.283629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:58.292184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:58.293669 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:58.294833 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-16f5676a-c963-4fa3-9d40-133a91891a31 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086571 May 16 17:28:58.295377 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1358/2990] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:28:59.313389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:28:59.314074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:28:59.320343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:59.320796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:59.321564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:28:59.322035 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:28:59.382751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:59.390818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:59.392305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:28:59.393431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-783528f6-c2d9-4044-96a5-880c828b049e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084669 May 16 17:28:59.394028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1359/2991] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:28:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:29:00.411319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:29:00.412061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:29:00.418330 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:29:00.418784 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:29:00.419550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:29:00.419991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:29:00.481174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:00.491000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:00.492482 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:00.493623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3da1d7de-8bfa-46fd-b52b-1979325865dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086308 May 16 17:29:00.494220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1360/2992] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:29:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:29:01.512007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:29:01.512625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:29:01.519001 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:29:01.519458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:29:01.520225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:29:01.520667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:29:01.580399 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:01.588552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:01.590087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:01.591258 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-efb84bbe-ad9c-4be3-95e5-11bfb4bbed2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083280 May 16 17:29:01.591817 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1361/2993] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:29:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:29:02.610221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:29:02.610922 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:29:02.617076 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:29:02.617538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:29:02.618328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:29:02.618769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:29:02.680595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:02.688698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:02.690239 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:29:02.691382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5ee36748-a979-47cb-8339-b6f72ec3e490 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085804 May 16 17:29:02.691937 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1362/2994] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:29:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:29:03.573906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c9605a9a-8774-4436-8e26-efe4c2f6c9a1 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feacdfdec10>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:04.125535 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-2e362b9b-2fa5-45a2-9968-cf1e2f89ff48 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2e362b9b-2fa5-45a2-9968-cf1e2f89ff48 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f HTTP/1.1 May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:30:04.128455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '7e1ab98b-05e9-4a1d-8060-7614686a141f'} May 16 17:30:04.130237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. (HTTP 404) (Request-ID: req-212545f1-07d2-4da9-b59c-3621786abcb0) May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:30:04.131604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:30:04.132998 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:30:04.134829 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-2e362b9b-2fa5-45a2-9968-cf1e2f89ff48 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-2e362b9b-2fa5-45a2-9968-cf1e2f89ff48 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f" status: 404 len: 109 microversion: 2.1 time: 120.543323 May 16 17:30:04.136148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1633/2995] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:28:03 2022] DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f => generated 109 bytes in 120545 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:30:04.137187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:04.137187 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:04.143313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:04.143490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:04.144150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:04.144579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:04.206687 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:04.215567 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:04.217070 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:04.218251 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-89059b8a-d3e3-41cc-be17-16ef6d8535dc tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086786 May 16 17:30:04.218816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1634/2996] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:30:04.223172 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-595e8eaa-6a21-4ea7-af93-eb4e6ec360ae tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feacda88a60>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:04.536927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-c9605a9a-8774-4436-8e26-efe4c2f6c9a1 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c9605a9a-8774-4436-8e26-efe4c2f6c9a1 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f HTTP/1.1 May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:30:04.541653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '7e1ab98b-05e9-4a1d-8060-7614686a141f'} May 16 17:30:04.543461 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. (HTTP 404) (Request-ID: req-93e8a3bf-7138-4c3e-aa62-35c9ef44c438) May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:30:04.544562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:30:04.546225 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:30:04.547765 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c9605a9a-8774-4436-8e26-efe4c2f6c9a1 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c9605a9a-8774-4436-8e26-efe4c2f6c9a1 tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f" status: 404 len: 109 microversion: 2.1 time: 60.973385 May 16 17:30:04.550052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1363/2997] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:29:03 2022] DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f => generated 109 bytes in 60975 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:30:04.552637 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:04.553257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:04.559184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:04.559643 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:04.560474 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:04.560915 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:04.625215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:04.637729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:04.639206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:04.640371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-41e0cb53-f15b-4e40-85f9-a34a57e31207 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.093027 May 16 17:30:04.640929 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1364/2998] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:04 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:30:05.658787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:05.659424 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:05.666542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:05.666936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:05.667716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:05.668157 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:05.732528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:05.743170 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:05.745292 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:05.746556 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4e1eb91c-9d21-4989-831f-c3b2fd37caaf tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.091774 May 16 17:30:05.747131 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1365/2999] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:05 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:06.764983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:06.765661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:06.771941 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:06.772386 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:06.773142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:06.773569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:06.834010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:06.842388 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:06.843895 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:06.845037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c95720ec-7434-44d9-b76e-0bbe78044421 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084014 May 16 17:30:06.845599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1366/3000] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:06 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:07.862818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:07.863520 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:07.871756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:07.872212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:07.872983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:07.873425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:07.939326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:07.947787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:07.949547 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:07.950717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6923b5fc-725e-4a02-baa3-038c404c4af9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.091826 May 16 17:30:07.951287 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1367/3001] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:07 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:30:08.968374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:08.969045 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:08.975310 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:08.975751 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:08.976541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:08.976981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:09.038303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:09.046389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:09.047882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:09.049022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-307f5902-6955-4b38-8bb4-e4622b0b7044 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084574 May 16 17:30:09.049595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1368/3002] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:08 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:10.067612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:10.068300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:10.074752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:10.075205 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:10.075968 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:10.076409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:10.135818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:10.144359 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:10.145882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:10.147026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-612ab02d-7695-40b0-bf34-7fa8d376d626 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083399 May 16 17:30:10.147579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1369/3003] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:10 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:11.164757 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:11.165407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:11.172250 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:11.172700 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:11.173458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:11.174414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:11.236628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:11.245776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:11.247267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:11.248432 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-d7d666e6-97ec-4b55-abac-cebd0d2f9315 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087697 May 16 17:30:11.249435 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1370/3004] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:11 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:30:12.266468 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:12.267465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:12.273566 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:12.274055 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:12.274819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:12.275256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:12.337477 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:12.345790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:12.347295 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:12.348441 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dc5e44ec-76b9-4663-b704-1125b8641e81 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085967 May 16 17:30:12.349002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1371/3005] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:12 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:13.366916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:13.367673 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:13.373769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:13.374241 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:13.375029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:13.375457 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:13.437526 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:13.445696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:13.447220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:13.448389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f1b4f99f-85e6-4b3d-afc6-929a9f38eb2a tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085358 May 16 17:30:13.449212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1372/3006] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:13 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:14.467042 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:14.467668 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:14.473972 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:14.474427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:14.475191 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:14.475627 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:14.535460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:14.543752 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:14.545249 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:14.546442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9729fbda-3ab9-4f93-81b7-5d41608040d9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083927 May 16 17:30:14.547007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1373/3007] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:14 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:15.564771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:15.565540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:15.571429 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:15.571876 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:15.572631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:15.573060 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:15.632909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:15.641992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:15.643508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:15.644670 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-75019e97-9a90-4be4-8e06-80997be6f209 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084205 May 16 17:30:15.645265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1374/3008] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:15 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:16.663753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:16.664458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:16.671348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:16.671802 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:16.672570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:16.673011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:16.738893 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:16.746832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:16.748371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:16.749513 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9e20f480-2414-4f05-b072-8f3e9b188e8d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.089699 May 16 17:30:16.750198 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1375/3009] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:16 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:17.769466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:17.770189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:17.777073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:17.777541 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:17.778414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:17.778868 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:17.855571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:17.863924 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:17.865412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:17.866575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-797f27e9-3c69-4633-bc31-143ee2948447 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.101165 May 16 17:30:17.867134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1376/3010] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:17 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:18.884522 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:18.885207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:18.892207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:18.892664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:18.893436 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:18.893912 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:18.954210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:18.962423 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:18.963927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:18.965074 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-cc8490a8-4684-4dca-8d1a-f547a1aa3c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084560 May 16 17:30:18.965629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1377/3011] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:18 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:19.983343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:19.984114 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:19.990188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:19.990647 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:19.991400 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:19.991830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:20.050976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:20.059586 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:20.061070 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:20.062231 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a6c39631-dac7-4727-b8be-9ce0d3638b6f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082824 May 16 17:30:20.062788 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1378/3012] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:19 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:21.080909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:21.081598 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:21.087861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:21.088314 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:21.089083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:21.089542 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:21.151989 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:21.161063 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:21.162678 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:21.164005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-15a81f9c-5a66-4a41-8a3a-9e9fe10caa0e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087712 May 16 17:30:21.164629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1379/3013] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:21 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:22.182476 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:22.183162 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:22.190058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:22.190508 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:22.191263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:22.191692 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:22.251894 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:22.260497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:22.262085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:22.263177 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7c46f1dd-b149-4f30-b2b0-6159248cd97f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084598 May 16 17:30:22.264403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1380/3014] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:22 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:23.281951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:23.282655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:23.288870 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:23.289324 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:23.290112 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:23.290549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:23.356489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:23.365032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:23.366564 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:23.367957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f9e1af13-3069-4e9a-a3e6-2bb357a02ba9 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.090668 May 16 17:30:23.368523 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1381/3015] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:23 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:24.385631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:24.386332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:24.393599 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:24.394111 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:24.394887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:24.395326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:24.455994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:24.464158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:24.465659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:24.467338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-adb6a730-4977-41ec-a125-fff85ad4a9a0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085079 May 16 17:30:24.467898 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1382/3016] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:24 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:25.484518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:25.485259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:25.491703 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:25.492104 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:25.492846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:25.493281 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:25.556597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:25.565403 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:25.566933 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:25.568072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3933e99c-5074-4bea-8636-02a56bd6bc65 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087609 May 16 17:30:25.568631 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1383/3017] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:25 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:26.586661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:26.587361 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:26.594257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:26.594717 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:26.595489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:26.595934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:26.669445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:26.677701 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:26.679257 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:26.680439 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-71ef88ce-20dc-4fb1-89ba-f3a00c97e6ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.097646 May 16 17:30:26.680998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1384/3018] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:26 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:27.701428 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:27.702108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:27.708527 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:27.708984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:27.709815 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:27.710254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:27.772962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:27.782952 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:27.784624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:27.786127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f4d5cab-958d-4a02-a8e3-bc2a44004c4b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.088887 May 16 17:30:27.786684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1385/3019] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:27 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:28.804679 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:28.805321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:28.812374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:28.812824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:28.813588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:28.814122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:28.880565 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:28.890653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:28.892268 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:28.893413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3894f323-0656-4a29-89de-b512edc3c966 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.092738 May 16 17:30:28.893992 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1386/3020] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:28 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:29.912118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:29.912793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:29.919326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:29.919776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:29.921412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:29.921412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:29.994030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:30.003196 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:30.004688 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:30.005856 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ca8d3b3c-f67d-4c52-a1cf-38a6ff732f37 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.098333 May 16 17:30:30.006414 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1387/3021] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:29 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:31.024184 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:31.024900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:31.031909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:31.032368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:31.033130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:31.033684 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:31.096926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:31.105790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:31.107300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:31.108460 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b788ecd2-6e43-4b20-a566-be18fc3ada75 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.088202 May 16 17:30:31.109030 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1388/3022] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:31 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:32.126763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:32.127453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:32.133832 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:32.134274 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:32.135037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:32.135518 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:32.199325 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:32.207843 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:32.209345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:32.211031 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2cf57862-2ada-4e50-a5a7-55e2d253aa34 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.088019 May 16 17:30:32.211417 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1389/3023] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:32 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:33.228629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:33.229306 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:33.235958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:33.236413 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:33.237219 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:33.237665 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:33.301602 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:33.309943 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:33.311447 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:33.313215 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a5fb4589-0c15-43e0-b343-dab1a3cff083 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.088591 May 16 17:30:33.313792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1390/3024] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:33 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:34.331595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:34.332303 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:34.338514 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:34.338973 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:34.339766 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:34.340202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:34.402317 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:34.410984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:34.412495 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:34.413654 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6af94a0a-967a-4dc7-9be8-38aa9d6658ea tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086598 May 16 17:30:34.414639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1391/3025] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:34 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:35.431600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:35.432220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:35.439050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:35.440961 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:35.441786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:35.442236 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:35.506242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:35.515058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:35.516609 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:35.517763 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-40461ea7-9f38-4b74-b9a3-d0b6d97d4541 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.090065 May 16 17:30:35.518335 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1392/3026] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:35 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:36.535596 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:36.536263 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:36.542490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:36.542939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:36.543696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:36.544130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:36.604569 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:36.612690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:36.614216 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:36.615348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-556066f2-b019-4175-ad7c-14844482a5a1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083705 May 16 17:30:36.615902 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1393/3027] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:36 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:37.634792 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:37.635453 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:37.642659 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:37.643121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:37.643900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:37.644343 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:37.705892 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:37.714134 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:37.715632 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:37.716770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-95527c50-f881-4325-9818-0f77badf49fd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086478 May 16 17:30:37.717338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1394/3028] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:37 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:38.736879 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:38.737567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:38.743726 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:38.744180 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:38.744942 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:38.745379 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:38.807032 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:38.815275 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:38.816798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:38.817994 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-eae10df8-81b7-4b1a-8df9-c12a690bdfd6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085652 May 16 17:30:38.818552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1395/3029] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:38 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:39.835614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:39.836305 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:39.842479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:39.842930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:39.844304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:39.844733 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:39.903606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:39.912300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:39.913818 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:39.914947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-34230581-7b7a-475a-b6b3-2619b018c586 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083313 May 16 17:30:39.915498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1396/3030] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:39 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:40.932338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:40.933090 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:40.939244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:40.939694 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:40.940455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:40.940890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:41.002007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:41.010309 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:41.011803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:41.012934 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-542b5ca3-ccd9-4abe-9acb-501409388e5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084477 May 16 17:30:41.013494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1397/3031] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:42.030851 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:42.031571 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:42.037785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:42.038243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:42.039011 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:42.039455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:42.099402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:42.107561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:42.109587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:42.110769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-603f1374-7b02-443b-9985-7c97fd565576 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083896 May 16 17:30:42.111350 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1398/3032] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:43.129256 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:43.130005 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:43.136242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:43.136731 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:43.137512 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:43.137978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:43.200820 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:43.209006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:43.210698 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:43.211901 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4f162676-f031-4b74-9af4-383669beae7c tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087324 May 16 17:30:43.212469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1399/3033] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:44.230288 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:44.230991 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:44.237615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:44.238092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:44.238849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:44.239284 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:44.299368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:44.307459 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:44.308958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:44.310123 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-93ecfe69-c4be-4496-975d-4ab0f095077b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083745 May 16 17:30:44.310683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1400/3034] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:44 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:45.328737 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:45.329998 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:45.335997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:45.336455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:45.337227 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:45.337672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:45.399347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:45.407624 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:45.409147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:45.410347 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2ef4a8c8-b5d5-4da6-a515-e54e9f3edec1 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085578 May 16 17:30:45.411161 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1401/3035] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:46.428760 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:46.429373 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:46.435789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:46.436245 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:46.437006 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:46.437444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:46.497307 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:46.505503 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:46.507041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:46.508183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2c20fba8-233b-4115-b780-97df11693f5d tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083339 May 16 17:30:46.508746 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1402/3036] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:46 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:47.525548 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:47.526220 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:47.532614 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:47.533073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:47.533873 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:47.534322 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:47.597442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:47.605754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:47.607267 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:47.608864 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-696b4eb3-bd53-4561-87d3-f443c1cfcedd tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087255 May 16 17:30:47.609434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1403/3037] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:47 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:48.627357 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:48.628050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:48.634374 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:48.634839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:48.635617 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:48.636059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:48.699402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:48.708203 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:48.709713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:48.710886 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4cbeaabe-10ce-48c5-a667-b3e6f5a471ca tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.087535 May 16 17:30:48.711455 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1404/3038] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:48 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:49.729664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:49.730425 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:49.737222 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:49.737840 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:49.738612 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:49.739050 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:49.801195 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:49.809269 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:49.810790 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:49.811927 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-39fd3fe4-34e8-4369-a404-0b87fd0cdf46 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086412 May 16 17:30:49.812494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1405/3039] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:49 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:50.832464 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:50.833252 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:50.839909 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:50.840364 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:50.841143 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:50.841587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:50.901846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:50.910595 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:50.912083 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:50.913206 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-faa2d6a1-f51e-475e-809f-dcef3c8abcf8 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086628 May 16 17:30:50.913786 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1406/3040] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:50 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:51.931370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:51.932081 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:51.938315 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:51.938773 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:51.939540 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:51.939977 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:52.019689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:52.027959 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:52.029444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:52.030608 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-ffe00844-1b0e-41a4-ab1a-8706536d7c43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.103181 May 16 17:30:52.031176 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1407/3041] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:51 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:53.048889 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:53.049577 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:53.056394 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:53.056839 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:53.057591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:53.058051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:53.117842 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:53.125932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:53.127431 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:53.128558 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8f2003d2-8423-4fd8-8a7c-53f1b6a11999 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083580 May 16 17:30:53.129137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1408/3042] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:53 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:54.146779 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:54.147484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:54.154405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:54.154854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:54.155610 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:54.156043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:54.215787 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:54.224931 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:54.226463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:54.227636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-92fbe88f-d5a0-41ff-a40f-e5e1833cc571 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084820 May 16 17:30:54.228211 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1409/3043] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:54 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:55.245497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:55.246226 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:55.252661 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:55.253106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:55.254002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:55.254754 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:55.315516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:55.324244 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:55.325796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:55.326890 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-899160d9-9a26-4463-ad99-d1085c150ba6 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.085449 May 16 17:30:55.327451 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1410/3044] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:55 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:56.345073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:56.346570 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:56.352982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:56.353410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:56.354371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:56.354808 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:56.423877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:56.432585 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:56.434109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:56.435242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5d976403-b533-4829-b7a4-d9e975da3aab tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.094236 May 16 17:30:56.435798 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1411/3045] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:56 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:57.454264 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:57.454887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:57.461199 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:57.461655 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:57.462465 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:57.462910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:57.522333 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:57.530553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:57.532058 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:57.533207 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b0be9c74-f5fc-4d39-8d64-4e9659f0b936 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.082894 May 16 17:30:57.533793 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1412/3046] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:57 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:58.551597 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:58.552240 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:58.558844 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:58.559302 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:58.560064 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:58.560521 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:58.620299 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:58.629152 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:58.633174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:58.634372 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b78224fe-c3d8-46bc-a7d5-b02791337115 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086807 May 16 17:30:58.634955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1413/3047] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:58 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:30:59.652826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:30:59.653466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:30:59.659753 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:59.660202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:59.660958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:30:59.661390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:30:59.722728 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:59.730982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:59.732488 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:30:59.733626 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-876b76d6-82e5-4f22-ac88-307805499a43 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.084718 May 16 17:30:59.734238 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1414/3048] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:30:59 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:31:00.751516 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:00.752166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:00.758356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:00.758830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:00.759576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:00.760013 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:00.822872 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:00.831410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:00.832920 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:00.834092 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-2f9bc3e2-95ab-4670-9faf-69b151f8a7f0 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.086593 May 16 17:31:00.834658 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1415/3049] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:00 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:31:01.852932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:01.853561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:01.859903 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:01.860356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:01.861115 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:01.861550 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:01.920783 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:01.928978 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:01.931169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:01.932318 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dbdcf2d9-0fa7-444a-af9b-be834d63522e tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083934 May 16 17:31:01.932882 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1416/3050] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:01 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:31:02.950910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:02.951899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:02.957899 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:02.958354 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:02.959118 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:02.959560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:03.019049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:03.027297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:03.028807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:03.029988 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0b37d341-e62d-41ff-af62-f738f75c9025 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.083216 May 16 17:31:03.030552 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1417/3051] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:02 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:31:03.688758 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-11bc6440-158e-4d69-a49d-3cf82ef30ddf tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feacdff5d30>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:38.571981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:31:38.572932 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f (ip 10.222.0.70) !!! May 16 17:31:40.508691 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-595e8eaa-6a21-4ea7-af93-eb4e6ec360ae tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-595e8eaa-6a21-4ea7-af93-eb4e6ec360ae tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f HTTP/1.1 May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:31:40.510747 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '7e1ab98b-05e9-4a1d-8060-7614686a141f'} May 16 17:31:40.512538 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. (HTTP 404) (Request-ID: req-e7575c77-91d0-4856-977f-6e06fb1e6dc9) May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.513916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:31:40.515377 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:31:40.519679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-595e8eaa-6a21-4ea7-af93-eb4e6ec360ae tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-595e8eaa-6a21-4ea7-af93-eb4e6ec360ae tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f" status: 404 len: 109 microversion: 2.1 time: 96.292427 May 16 17:31:40.522574 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1635/3052] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:30:04 2022] DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f => generated 109 bytes in 96295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:31:40.525951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:40.525951 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:40.528455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:40.528918 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:40.529761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:40.530230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:40.601074 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:40.604127 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-11bc6440-158e-4d69-a49d-3cf82ef30ddf tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-11bc6440-158e-4d69-a49d-3cf82ef30ddf tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f HTTP/1.1 May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:31:40.606334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '7e1ab98b-05e9-4a1d-8060-7614686a141f'} May 16 17:31:40.607999 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. (HTTP 404) (Request-ID: req-b669d2b3-227d-4c15-9129-54280174f48f) May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.609494 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:31:40.610849 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:31:40.613594 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-11bc6440-158e-4d69-a49d-3cf82ef30ddf tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 7e1ab98b-05e9-4a1d-8060-7614686a141f could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-11bc6440-158e-4d69-a49d-3cf82ef30ddf tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f" status: 404 len: 109 microversion: 2.1 time: 36.922987 May 16 17:31:40.616576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1418/3053] 10.222.0.70 () {58 vars in 1247 bytes} [Mon May 16 17:31:03 2022] DELETE /compute/v2.1/os-volumes/7e1ab98b-05e9-4a1d-8060-7614686a141f => generated 109 bytes in 36928 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:31:40.619519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:40.619519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:40.619519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-925cf0f2-2012-4fff-a454-b09160ec72d2 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1444 microversion: 2.20 time: 0.101194 May 16 17:31:40.619808 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1636/3054] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:40 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:31:40.627233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-51e3c795-546f-4d72-a114-0c93e8af759e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Calling method '.version_select at 0x7feace2b7280>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:40.900033 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-51e3c795-546f-4d72-a114-0c93e8af759e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] HTTP exception thrown: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-51e3c795-546f-4d72-a114-0c93e8af759e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Request method failure captured: May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: GET /compute/v2.1/os-volumes/8686187d-eeb2-44f3-8d4d-3255a20f3410 HTTP/1.1 May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoi25IViNt_TuL4uO96ENMTOyZaE7O6KW9m0dBfmbklJo07kq9lzBgf5d-w-Euw9E5nX6GJtd0o1P6npBASgqZPFaW7g0RKOA_psCAXjU8Sdd3nLmWewG0ugKWgv4IHcKua5ia_yT42ch-9IAzdvS-byE2LW7Db5i2SDYHrBwFfpfws May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:31:40.905619 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96bd5598466d47718e0a2522d2211d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 96bd5598466d47718e0a2522d2211d2b May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-VolumesNegativeTest-1033679543 May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-VolumesNegativeTest-1033679543-project May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: bd8cf7b9f208496f9fc4b74199a82c59 May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-VolumesNegativeTest-1033679543-project May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '8686187d-eeb2-44f3-8d4d-3255a20f3410'} May 16 17:31:40.907445 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. (HTTP 404) (Request-ID: req-b69c1137-2698-4e3b-b9b9-dfafdb0ac609) May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.908463 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:31:40.910052 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 17:31:40.911498 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-51e3c795-546f-4d72-a114-0c93e8af759e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] Returning 404 to user: Volume 8686187d-eeb2-44f3-8d4d-3255a20f3410 could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:31:40.912936 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-51e3c795-546f-4d72-a114-0c93e8af759e tempest-VolumesNegativeTest-1033679543 tempest-VolumesNegativeTest-1033679543-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8686187d-eeb2-44f3-8d4d-3255a20f3410" status: 404 len: 109 microversion: 2.1 time: 0.291682 May 16 17:31:40.920300 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1419/3055] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 17:31:40 2022] GET /compute/v2.1/os-volumes/8686187d-eeb2-44f3-8d4d-3255a20f3410 => generated 109 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:31:41.636791 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:41.637916 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:41.649290 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:41.649881 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:41.650970 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:41.651485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:41.688478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:41.689029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:41.689490 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lazy-loading 'fault' on Instance uuid 066f9c81-9fa1-430d-9691-d04ea3c538de {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:31:41.746927 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:41.756327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:41.758340 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:41.759885 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c6d52cdb-a25e-4929-9de6-2ac6f5b91871 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1538 microversion: 2.20 time: 0.129731 May 16 17:31:41.760651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1637/3056] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:41 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1538 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:31:42.777979 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:42.778636 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:42.785921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:42.786390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:42.787234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:42.787693 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:42.823355 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:42.823819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:42.824321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lazy-loading 'fault' on Instance uuid 066f9c81-9fa1-430d-9691-d04ea3c538de {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:31:42.866881 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:42.878368 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:42.880029 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:42.884707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b52b4d82-1876-414f-b892-28c6f0e68b2f tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1538 microversion: 2.20 time: 0.107961 May 16 17:31:42.884707 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1420/3057] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:42 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1538 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:31:43.901452 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:43.902730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:43.909711 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:43.910200 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:43.910987 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:43.911431 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:43.949461 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:43.950325 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:43.950919 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.objects.instance [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lazy-loading 'fault' on Instance uuid 066f9c81-9fa1-430d-9691-d04ea3c538de {{(pid=117184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:31:44.037544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:44.051964 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:44.053478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58633f982d3840dd88f631bcee882f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b1d6066aaf4e969b8c69cd72d1de4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:31:44.055160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-96f73307-d457-4428-9bd5-74df4ef08b41 tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 200 len: 1538 microversion: 2.20 time: 0.159070 May 16 17:31:44.056156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1638/3058] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:43 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 1538 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:31:44.909591 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-68a4b35b-64f9-4ae7-87c4-3123921b0a68 req-7a5a90cf-fe0b-4e49-ace4-51128502d570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38da705b-728f-449a-99ef-1428962695d3", "name": "network-vif-deleted", "tag": "be876588-aea6-45b4-9f5d-c0b6fe68b534"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:31:44.922930 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-68a4b35b-64f9-4ae7-87c4-3123921b0a68 req-7a5a90cf-fe0b-4e49-ace4-51128502d570 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:44.923381 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-68a4b35b-64f9-4ae7-87c4-3123921b0a68 req-7a5a90cf-fe0b-4e49-ace4-51128502d570 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:44.937887 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-68a4b35b-64f9-4ae7-87c4-3123921b0a68 req-7a5a90cf-fe0b-4e49-ace4-51128502d570 service nova] Creating event network-vif-deleted:be876588-aea6-45b4-9f5d-c0b6fe68b534 for instance 38da705b-728f-449a-99ef-1428962695d3 on hv-cinder-83998 May 16 17:31:44.943950 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-68a4b35b-64f9-4ae7-87c4-3123921b0a68 req-7a5a90cf-fe0b-4e49-ace4-51128502d570 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267337 May 16 17:31:44.944963 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1421/3059] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:31:45.073181 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:45.073936 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] [instance: 066f9c81-9fa1-430d-9691-d04ea3c538de] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:31:45.080877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:45.083873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:45.085474 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:45.087416 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:45.108327 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] HTTP exception thrown: Instance 066f9c81-9fa1-430d-9691-d04ea3c538de could not be found. May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Request method failure captured: May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de HTTP/1.1 May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJOYq7A2zC7aJIKkY94WOgT3Mq8mAKo6OS9vGmVf91cM7NXMu3zRbUwa5iQ4ZPMwxPtlN9GJ5iVIXGA5rn3Bn3GcJJ9_MGA1jdJ9pg8jQAUh_UojrNQhpCxws77tuEXBbsJn7_9n95bEG9VB1eyCRLpfqTCYQ565KUxZdIBvbKWaBk May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:31:45.111370 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/08b1d6066aaf4e969b8c69cd72d1de4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 08b1d6066aaf4e969b8c69cd72d1de4e May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1945120915 May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 58633f982d3840dd88f631bcee882f5f May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1945120915-project May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 066f9c81-9fa1-430d-9691-d04ea3c538de could not be found. May 16 17:31:45.113178 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '066f9c81-9fa1-430d-9691-d04ea3c538de'} May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066f9c81-9fa1-430d-9691-d04ea3c538de could not be found. May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:31:45.114229 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066f9c81-9fa1-430d-9691-d04ea3c538de could not be found. May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066f9c81-9fa1-430d-9691-d04ea3c538de could not be found. May 16 17:31:45.116633 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:31:45.119031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] Returning 404 to user: Instance 066f9c81-9fa1-430d-9691-d04ea3c538de could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:31:45.119031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-0261a618-3ca8-41ff-b7fb-157765a9016b tempest-AttachVolumeShelveTestJSON-1945120915 tempest-AttachVolumeShelveTestJSON-1945120915-project] 10.222.0.70 "GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de" status: 404 len: 111 microversion: 2.20 time: 0.044790 May 16 17:31:45.119031 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1639/3060] 10.222.0.70 () {60 vars in 1276 bytes} [Mon May 16 17:31:45 2022] GET /compute/v2.1/servers/066f9c81-9fa1-430d-9691-d04ea3c538de => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:31:45.412096 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:31:45.412249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:31:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:32:02.496016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:32:02.496639 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:33:03.614857 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-3f4f80e1-cb5c-4be0-be41-6e54ed63392b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Action: 'create', calling method: .version_select at 0x7feace29da60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1654863699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHPvcrRHTaEcCHF1XaHHEZi+UKeXn7cuU5X86qGngzX1n6VV7GaAMQwxZNDMncleK2ja4RL+9hcjvnZo6+E39e5N1FqWb0g4EGSfA/8Eq+J1oEwlhRrAgn8ZSt7hMS/bw=="}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:03.629720 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-3f4f80e1-cb5c-4be0-be41-6e54ed63392b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for project 56b80ff77ba34997843a869bd2707989. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:33:03.633663 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-3f4f80e1-cb5c-4be0-be41-6e54ed63392b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for user a2a9871c81d649a897166091dd1d4af8 and project 56b80ff77ba34997843a869bd2707989. Resources: {'key_pairs'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:33:03.663338 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-3f4f80e1-cb5c-4be0-be41-6e54ed63392b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.278170 May 16 17:33:03.664041 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1422/3061] 10.222.0.70 () {60 vars in 1158 bytes} [Mon May 16 17:33:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:28.319128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1893690773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1654863699", "security_groups": [{"name": "tempest-secgroup-smoke-1420321525"}], "block_device_mapping_v2": [{"uuid": "ac67914b-f16a-4bd4-882e-e1b7d3b58433", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad3ce516-d5b8-462f-89a5-dee1c898f741"}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:28.480584 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] validate_networks() for [('ad3ce516-d5b8-462f-89a5-dee1c898f741', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:33:28.943505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:33:28.943922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:33:28.944397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:33:28.944804 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:33:28.945212 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:33:28.955199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:28.955645 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:28.956437 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:28.956869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:28.973194 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for project 56b80ff77ba34997843a869bd2707989. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:33:28.976994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for user a2a9871c81d649a897166091dd1d4af8 and project 56b80ff77ba34997843a869bd2707989. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:33:29.031694 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:33:29.034335 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac67914b-f16a-4bd4-882e-e1b7d3b58433',volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:33:29.156573 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-284d1ad0-ea1d-437c-aff8-6b5b64aa6243 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842673 May 16 17:33:29.160565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1640/3062] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:33:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:33:29.168415 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-fa9b593c-4458-4162-a28e-825981a61d62 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:29.169148 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-fa9b593c-4458-4162-a28e-825981a61d62 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:29.278353 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-fa9b593c-4458-4162-a28e-825981a61d62 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:29.284846 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-fa9b593c-4458-4162-a28e-825981a61d62 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1095 microversion: 2.1 time: 0.120874 May 16 17:33:29.285410 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1423/3063] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:29 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:30.303249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:30.303900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:30.309882 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:30.310338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:30.311110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:30.311555 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:30.384725 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:30.393684 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b9cee524-81d5-4d7d-b9ff-4352e32b790f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1211 microversion: 2.1 time: 0.095462 May 16 17:33:30.394273 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1641/3064] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:30 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:31.418260 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:31.418880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:31.425396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:31.425880 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:31.426653 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:31.427094 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:31.567990 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:31.577185 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-83a361c7-38ec-40ae-aecb-830c39f950eb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.162253 May 16 17:33:31.578567 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1424/3065] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:31 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:31.779375 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29847fc0-9183-4628-94f2-e358c014855f", "tag": "242504c1-e97a-4a20-a6e4-08d55d1d169f"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:31.790755 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:31.791571 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:31.806455 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] Creating event network-changed:242504c1-e97a-4a20-a6e4-08d55d1d169f for instance 29847fc0-9183-4628-94f2-e358c014855f on hv-cinder-83998 May 16 17:33:31.810304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR oslo.messaging._drivers.impl_rabbit [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] [04a3d4df-1259-4a0a-9e9b-162c33d752d6] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 17:33:32.595530 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:32.596168 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:32.602633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:32.603080 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:32.603838 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:32.604296 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:32.730639 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:32.739169 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-985da8ba-c149-4098-832f-077bae8a2a91 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.147768 May 16 17:33:32.739742 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1425/3066] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:32 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:33:32.817880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] [04a3d4df-1259-4a0a-9e9b-162c33d752d6] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 49040. May 16 17:33:32.821674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-0f58215a-b4df-4d3e-b7e1-833168b025f8 req-76f2a7f5-00af-428e-8377-c46889b6dec3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.046844 May 16 17:33:32.822392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1642/3067] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:33.755397 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:33.756012 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:33.762297 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:33.762748 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:33.763544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:33.763982 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:33.899392 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:33.906877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c3eccd38-4643-4521-99dd-a5698a5f3ddf tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.155261 May 16 17:33:33.909519 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1426/3068] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:33 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:34.924969 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:34.925703 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:34.931779 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:34.932230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:34.932994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:34.933582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:35.065115 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:35.072596 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6d05ad88-b21e-4d64-a814-d5d390e4f775 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.152328 May 16 17:33:35.073165 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1643/3069] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:34 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:33:36.089028 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:36.089640 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:36.096633 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:36.097086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:36.097884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:36.098344 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:36.236390 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:36.243689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f07c36c9-21da-4945-b8aa-f59b3b1e5e9b tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.158513 May 16 17:33:36.244247 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1427/3070] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:36 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:37.260338 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:37.260982 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:37.268018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:37.268463 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:37.269233 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:37.269668 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:37.401837 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:37.409727 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c3d876e8-6fe2-4eed-a637-9d163db691ce tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.153178 May 16 17:33:37.410547 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1644/3071] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:37 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:38.426715 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:38.427328 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:38.433687 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:38.434175 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:38.434935 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:38.435370 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:38.569466 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:38.577158 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-9edc7dcf-6004-40de-b23c-5d208485613e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.154849 May 16 17:33:38.578002 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1428/3072] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:38 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:39.593671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:39.594294 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:39.600635 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:39.601089 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:39.601907 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:39.602344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:39.733448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:39.741381 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-34ffa730-9b63-4df4-9ff8-110541d74b69 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.151479 May 16 17:33:39.741971 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1645/3073] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:39 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:40.757380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:40.758093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:40.764237 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:40.764691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:40.765469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:40.766200 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:40.901830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:40.909589 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-32b15b88-e948-455b-b18b-c116c6f46fea tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.156092 May 16 17:33:40.910189 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1429/3074] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:40 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:33:41.926952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:41.927564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:41.934420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:41.934864 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:41.935630 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:41.936063 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:42.068167 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:42.075674 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-aa4a5262-022d-4fd7-82bb-de5e89fbdddd tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.153256 May 16 17:33:42.076237 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1646/3075] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:41 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:42.700151 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-4b81cbf7-5a8c-495b-9880-6c97048a9a33 req-825acd95-d91a-42d5-9792-1e69090c92f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29847fc0-9183-4628-94f2-e358c014855f", "name": "network-vif-plugged", "status": "completed", "tag": "242504c1-e97a-4a20-a6e4-08d55d1d169f"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:42.708243 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-4b81cbf7-5a8c-495b-9880-6c97048a9a33 req-825acd95-d91a-42d5-9792-1e69090c92f6 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:42.708680 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-4b81cbf7-5a8c-495b-9880-6c97048a9a33 req-825acd95-d91a-42d5-9792-1e69090c92f6 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:42.720606 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-4b81cbf7-5a8c-495b-9880-6c97048a9a33 req-825acd95-d91a-42d5-9792-1e69090c92f6 service nova] Creating event network-vif-plugged:242504c1-e97a-4a20-a6e4-08d55d1d169f for instance 29847fc0-9183-4628-94f2-e358c014855f on hv-cinder-83998 May 16 17:33:42.725826 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-4b81cbf7-5a8c-495b-9880-6c97048a9a33 req-825acd95-d91a-42d5-9792-1e69090c92f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144676 May 16 17:33:42.726479 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1430/3076] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:43.092800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:43.093419 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:43.100688 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:43.101140 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:43.101942 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:43.102387 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:43.237637 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:43.244930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-30400ab9-03b0-41be-97f1-866224c30510 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.156090 May 16 17:33:43.245498 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1647/3077] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:43 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:44.262736 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:44.263438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:44.283321 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:44.283785 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:44.284587 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:44.285351 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:44.464525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:44.476440 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-91dea62d-8214-4142-8601-31575bc0e14a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1267 microversion: 2.1 time: 0.218479 May 16 17:33:44.477113 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1431/3078] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:44 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:45.493058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:45.493670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:45.499460 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:45.499906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:45.500665 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:45.501098 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:45.629247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:45.636496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b8b78923-e8ea-42e7-b53a-31c26956e93d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1454 microversion: 2.1 time: 0.147385 May 16 17:33:45.637106 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1648/3079] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:45 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:45.653087 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:45.653702 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:33:45.660135 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:45.660584 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:45.661345 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:45.661862 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:45.789137 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:33:45.796433 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-0fa9b0c8-3d2e-4cfb-b616-83ba1dd455aa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1454 microversion: 2.1 time: 0.147426 May 16 17:33:45.797000 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1432/3080] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:33:45 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:33:47.620361 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-e1730e94-e697-4205-b115-a75b752bf1fc req-e32002c9-f155-49f3-9afe-928a045eebe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29847fc0-9183-4628-94f2-e358c014855f", "tag": "242504c1-e97a-4a20-a6e4-08d55d1d169f"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:47.629036 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e1730e94-e697-4205-b115-a75b752bf1fc req-e32002c9-f155-49f3-9afe-928a045eebe2 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:33:47.629489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-e1730e94-e697-4205-b115-a75b752bf1fc req-e32002c9-f155-49f3-9afe-928a045eebe2 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:33:47.641700 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-e1730e94-e697-4205-b115-a75b752bf1fc req-e32002c9-f155-49f3-9afe-928a045eebe2 service nova] Creating event network-changed:242504c1-e97a-4a20-a6e4-08d55d1d169f for instance 29847fc0-9183-4628-94f2-e358c014855f on hv-cinder-83998 May 16 17:33:47.648587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-e1730e94-e697-4205-b115-a75b752bf1fc req-e32002c9-f155-49f3-9afe-928a045eebe2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155966 May 16 17:33:47.649439 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1649/3081] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:34:58.582334 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:34:58.582967 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:35:05.421146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:35:05.421655 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:35:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:35:06.884086 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:35:06.884683 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:35:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:35:42.701059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf70c39b-bb14-4c70-8ff7-aa588f6a1762] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 16 17:35:42.704823 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:42.705323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:42.712039 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:42.712497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:42.713266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:42.713712 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:42.738875 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:35:42.811014 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7ea125ee-18da-418e-91db-0a07e24538ad tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 204 len: 0 microversion: 2.1 time: 0.111534 May 16 17:35:42.811600 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1433/3082] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:35:42 2022] DELETE /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:35:42.821848 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:42.822579 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:42.828644 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:42.829174 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:42.830048 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:42.830488 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:42.959954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:42.967289 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-f4f7bf68-665e-4b7d-8b24-de42943fc1ac tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1579 microversion: 2.1 time: 0.150851 May 16 17:35:42.967853 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1650/3083] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:42 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:43.985497 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:43.986167 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:43.997117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:43.997117 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:43.997470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:43.997772 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:44.001490 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf70c39b-bb14-4c70-8ff7-aa588f6a1762] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 49524. May 16 17:35:44.130921 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:44.138235 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-a71e3fc9-6a1b-400e-8470-c4a654a64576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1579 microversion: 2.1 time: 0.157370 May 16 17:35:44.138796 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1434/3084] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:43 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:45.154857 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:45.155476 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:45.161818 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:45.162270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:45.163043 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:45.163480 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:45.228693 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:45.236058 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-9de691ca-9cff-4ea9-b82f-262c0544d6c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 200 len: 1511 microversion: 2.1 time: 0.085223 May 16 17:35:45.236627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1651/3085] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:45 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:45.327830 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-f0355cd2-4f11-4df5-9878-17d4b07e2ae9 req-6081693f-8b10-4166-8d03-a1178b65683a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29847fc0-9183-4628-94f2-e358c014855f", "name": "network-vif-deleted", "tag": "242504c1-e97a-4a20-a6e4-08d55d1d169f"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:35:45.337910 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-f0355cd2-4f11-4df5-9878-17d4b07e2ae9 req-6081693f-8b10-4166-8d03-a1178b65683a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:45.338572 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-f0355cd2-4f11-4df5-9878-17d4b07e2ae9 req-6081693f-8b10-4166-8d03-a1178b65683a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:45.351916 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-f0355cd2-4f11-4df5-9878-17d4b07e2ae9 req-6081693f-8b10-4166-8d03-a1178b65683a service nova] Creating event network-vif-deleted:242504c1-e97a-4a20-a6e4-08d55d1d169f for instance 29847fc0-9183-4628-94f2-e358c014855f on hv-cinder-83998 May 16 17:35:45.358096 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-f0355cd2-4f11-4df5-9878-17d4b07e2ae9 req-6081693f-8b10-4166-8d03-a1178b65683a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034478 May 16 17:35:45.359136 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1435/3086] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:35:46.254312 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:46.255493 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:46.262119 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:46.262572 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:46.263341 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:46.263775 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:46.277082 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] HTTP exception thrown: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Request method failure captured: May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f HTTP/1.1 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigorJzftzXvjSlZjyA9Bc1D8i7pEO0qjBDlX2OgTNAmgEON0JK2waPtOuLw0itM_pJmw4SvqOrLvDk5j1VDbfT4rwA-dTzyU6VqVAxWppG8auGSxpFZ9Ff0RvEVjHMzL0VIaaGmOH95fMnWHd4744TE2E7mDpGviY4G3m8k4zNkgwV74 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:35:46.278922 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56b80ff77ba34997843a869bd2707989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56b80ff77ba34997843a869bd2707989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-TestVolumeBootPattern-771000302 May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-TestVolumeBootPattern-771000302-project May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: a2a9871c81d649a897166091dd1d4af8 May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-TestVolumeBootPattern-771000302-project May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:35:46.280646 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '29847fc0-9183-4628-94f2-e358c014855f'} May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:35:46.282040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:35:46.284087 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:35:46.285696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Returning 404 to user: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:35:46.285696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-929b6ce6-ed2b-4953-967c-ee7a74dd9a4a tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 404 len: 111 microversion: 2.1 time: 0.030729 May 16 17:35:46.286587 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1652/3087] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:46 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:35:46.405996 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1445233653", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1654863699", "security_groups": [{"name": "tempest-secgroup-smoke-1420321525"}], "block_device_mapping_v2": [{"uuid": "ac67914b-f16a-4bd4-882e-e1b7d3b58433", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad3ce516-d5b8-462f-89a5-dee1c898f741"}]}} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:35:46.528405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.network.neutron [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] validate_networks() for [('ad3ce516-d5b8-462f-89a5-dee1c898f741', None, None, None, None, None)] {{(pid=117183) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:35:46.953538 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Flavor limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:35:46.953997 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Image limits 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:35:46.954475 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Flavor pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:35:46.954884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Image pref 0:0:0 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:35:46.955320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.virt.hardware [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:35:46.964625 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:46.965073 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:46.965906 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:46.966348 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:46.983103 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for project 56b80ff77ba34997843a869bd2707989. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:35:46.986962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.quota [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for user a2a9871c81d649a897166091dd1d4af8 and project 56b80ff77ba34997843a869bd2707989. Resources: {'instances', 'ram', 'cores'} {{(pid=117183) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:35:47.049525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Going to run 1 instances... {{(pid=117183) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:35:47.052259 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac67914b-f16a-4bd4-882e-e1b7d3b58433',volume_size=None,volume_type=None)] {{(pid=117183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:35:47.186213 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-56bc3f94-c19d-4564-b7a5-5619baee33a8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784847 May 16 17:35:47.186858 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1436/3088] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:35:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:35:47.199385 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-19679497-e963-4b84-aadc-32acb3ad8c49 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:47.200166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-19679497-e963-4b84-aadc-32acb3ad8c49 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:47.266364 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-19679497-e963-4b84-aadc-32acb3ad8c49 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:47.273513 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-19679497-e963-4b84-aadc-32acb3ad8c49 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1095 microversion: 2.1 time: 0.080070 May 16 17:35:47.274443 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1653/3089] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:47 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:48.291536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:48.292251 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:48.298797 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:48.299356 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:48.300140 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:48.300575 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:48.376528 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:48.384667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4123cea1-dd15-4a54-8264-53b25e75a9f8 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1211 microversion: 2.1 time: 0.097317 May 16 17:35:48.392745 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1437/3090] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:48 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:49.404420 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:49.405880 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:49.418653 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:49.419104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:49.419876 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:49.420313 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:49.648592 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:49.657960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-92b5054c-52c2-44ef-b8a2-1b885fe60d21 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.258224 May 16 17:35:49.659276 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1654/3091] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:49 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:49.798183 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [req-43112a8a-8e37-4e0e-9a63-f3d5e64c7856 req-8b4d2c08-c512-48a9-832c-cf55a5909d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bc744d-e476-4d5f-8268-d08f077cba52", "tag": "c363d6a4-6a17-4ebb-9aa7-2390652e120d"}]} {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:35:49.808623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-43112a8a-8e37-4e0e-9a63-f3d5e64c7856 req-8b4d2c08-c512-48a9-832c-cf55a5909d2c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:49.809066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [req-43112a8a-8e37-4e0e-9a63-f3d5e64c7856 req-8b4d2c08-c512-48a9-832c-cf55a5909d2c service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:49.822442 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.compute.server_external_events [req-43112a8a-8e37-4e0e-9a63-f3d5e64c7856 req-8b4d2c08-c512-48a9-832c-cf55a5909d2c service nova] Creating event network-changed:c363d6a4-6a17-4ebb-9aa7-2390652e120d for instance 78bc744d-e476-4d5f-8268-d08f077cba52 on hv-cinder-83998 May 16 17:35:49.829242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [req-43112a8a-8e37-4e0e-9a63-f3d5e64c7856 req-8b4d2c08-c512-48a9-832c-cf55a5909d2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043541 May 16 17:35:49.834146 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1438/3092] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:35:50.675560 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:50.676867 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:50.683386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:50.683831 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:50.684602 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:50.685030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:50.909304 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:50.917492 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b814c951-961b-46f3-b7ef-cde5b2f7adfe tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.245894 May 16 17:35:50.918177 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1655/3093] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:50 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:51.934777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:51.935469 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:51.942132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:51.942672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:51.943711 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:51.944149 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:52.076110 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:52.083926 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-426b4930-25e2-4b15-8a1c-ab3a6257350d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.153793 May 16 17:35:52.084509 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1439/3094] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:51 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:53.100648 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:53.101252 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:53.107611 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:53.108062 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:53.108816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:53.109248 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:53.240593 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:53.250285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-bd8389f5-87e7-499e-b69b-6983a66c5561 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.154046 May 16 17:35:53.250868 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1656/3095] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:53 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:54.272085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:54.272699 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:54.279121 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:54.279576 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:54.280337 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:54.280769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:54.418675 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:54.426049 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-effe9530-d5d5-4afc-9914-914c78315e15 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.157930 May 16 17:35:54.426618 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1440/3096] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:54 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:55.442612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:55.443478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:55.449903 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:55.450353 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:55.451113 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:55.451544 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:55.584440 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:55.592249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-93d6a7e4-0174-499c-8704-97ba89298cf1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.153533 May 16 17:35:55.592839 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1657/3097] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:55 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:56.609947 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:56.610615 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:56.617434 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:56.617938 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:56.618708 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:56.619145 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:56.755601 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:56.764458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-5477c574-1c25-4c95-a310-150657685fdb tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.158401 May 16 17:35:56.765043 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1441/3098] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:56 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:57.782716 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:57.783464 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:57.790554 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:57.791010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:57.791794 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:57.792285 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:57.923681 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:57.930952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3028a142-6e9f-4945-b997-ca51e99b5f0c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.152400 May 16 17:35:57.931530 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1658/3099] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:57 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:58.949813 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:35:58.950629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:35:58.957807 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:58.958266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:58.959037 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:58.959471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:59.102734 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:35:59.110072 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-615f0169-5766-4f14-a116-929e47e6d8e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.165071 May 16 17:35:59.110667 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1442/3100] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:35:58 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:35:59.143817 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-cfc30649-fb92-40f9-9719-1508a72aa8d2 req-8fe01070-ee4a-4bba-aeba-9da2463ab32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bc744d-e476-4d5f-8268-d08f077cba52", "name": "network-vif-plugged", "status": "completed", "tag": "c363d6a4-6a17-4ebb-9aa7-2390652e120d"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:35:59.152669 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-cfc30649-fb92-40f9-9719-1508a72aa8d2 req-8fe01070-ee4a-4bba-aeba-9da2463ab32d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:35:59.153139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-cfc30649-fb92-40f9-9719-1508a72aa8d2 req-8fe01070-ee4a-4bba-aeba-9da2463ab32d service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:35:59.164771 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-cfc30649-fb92-40f9-9719-1508a72aa8d2 req-8fe01070-ee4a-4bba-aeba-9da2463ab32d service nova] Creating event network-vif-plugged:c363d6a4-6a17-4ebb-9aa7-2390652e120d for instance 78bc744d-e476-4d5f-8268-d08f077cba52 on hv-cinder-83998 May 16 17:35:59.169997 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-cfc30649-fb92-40f9-9719-1508a72aa8d2 req-8fe01070-ee4a-4bba-aeba-9da2463ab32d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029979 May 16 17:35:59.170601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1659/3101] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:00.127544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:00.128156 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:36:00.135450 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:00.135907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:00.136690 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:00.137132 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:00.272452 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:36:00.279834 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-22386975-9b66-41b4-b528-04e89cb96576 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1267 microversion: 2.1 time: 0.156342 May 16 17:36:00.280409 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1443/3102] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:36:00 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:36:01.297435 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:01.298071 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:36:01.304475 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:01.304930 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:01.305699 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:01.306163 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:01.438869 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:36:01.446582 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-352aef21-2a90-4d89-8c74-8758e39647a7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1455 microversion: 2.1 time: 0.153862 May 16 17:36:01.447156 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1660/3103] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:36:01 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:36:01.463034 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:01.463697 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:36:01.469984 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:01.470446 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:01.471212 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:01.471651 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:01.598141 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:36:01.605369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-70e2d263-7848-44ff-a66e-53b7d72c2b61 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1455 microversion: 2.1 time: 0.146694 May 16 17:36:01.605970 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1444/3104] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:36:01 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:36:03.435944 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-bcf79499-9e3d-495a-98ff-1cb8bcad4e7d req-a1e8732b-ff4d-4bdf-ad58-0903704323fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bc744d-e476-4d5f-8268-d08f077cba52", "tag": "c363d6a4-6a17-4ebb-9aa7-2390652e120d"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:36:03.448612 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-bcf79499-9e3d-495a-98ff-1cb8bcad4e7d req-a1e8732b-ff4d-4bdf-ad58-0903704323fa service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:03.450225 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-bcf79499-9e3d-495a-98ff-1cb8bcad4e7d req-a1e8732b-ff4d-4bdf-ad58-0903704323fa service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:03.461718 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-bcf79499-9e3d-495a-98ff-1cb8bcad4e7d req-a1e8732b-ff4d-4bdf-ad58-0903704323fa service nova] Creating event network-changed:c363d6a4-6a17-4ebb-9aa7-2390652e120d for instance 78bc744d-e476-4d5f-8268-d08f077cba52 on hv-cinder-83998 May 16 17:36:03.466870 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-bcf79499-9e3d-495a-98ff-1cb8bcad4e7d req-a1e8732b-ff4d-4bdf-ad58-0903704323fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034726 May 16 17:36:03.467626 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1661/3105] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:04.060407 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:04.060974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:36:04.067165 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:04.067623 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:04.068689 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:04.069122 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:04.083093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] HTTP exception thrown: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Request method failure captured: May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d HTTP/1.1 May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigoJRyCdr02Qdnm-CiAQNNbE-zaX4uOdJA_-jKYs_NxSxnWqpeGOWOO_Tm1isBIxRzVV8bYiXuNcTyzaKYoW9wWJYT6N2STMggEn3HCE9-TrIdIyUDkoJJkh4ayGr2aK8VvMW0DQAdudPATFdOo1iVa9lMtJYT_4h3zEwPP6hItA9GzM May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:36:04.084811 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-AttachVolumeTestJSON-1930646859 May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: 189966fbd18f4152b6b54ba5492034e0 May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.086418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': 'bb86dab5-8d6b-4d24-969a-687c2224d48d'} May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:36:04.087560 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.088974 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:36:04.090776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Returning 404 to user: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:36:04.090776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-43582e83-8cc6-44e6-aece-d3a0808abfd9 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 404 len: 111 microversion: 2.1 time: 0.029732 May 16 17:36:04.090776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1445/3106] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:36:04 2022] DELETE /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:36:04.095403 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:04.096110 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] [instance: bb86dab5-8d6b-4d24-969a-687c2224d48d] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:36:04.103040 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:04.103425 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:04.104195 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:36:04.104636 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:36:04.119097 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] HTTP exception thrown: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Request method failure captured: May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d HTTP/1.1 May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigoJRyCdr02Qdnm-CiAQNNbE-zaX4uOdJA_-jKYs_NxSxnWqpeGOWOO_Tm1isBIxRzVV8bYiXuNcTyzaKYoW9wWJYT6N2STMggEn3HCE9-TrIdIyUDkoJJkh4ayGr2aK8VvMW0DQAdudPATFdOo1iVa9lMtJYT_4h3zEwPP6hItA9GzM May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:36:04.120742 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/59a45b25fa9e4a4bb9e144de365602bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-AttachVolumeTestJSON-1930646859 May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 59a45b25fa9e4a4bb9e144de365602bc May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1930646859 May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: 189966fbd18f4152b6b54ba5492034e0 May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-AttachVolumeTestJSON-1930646859-project May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.122453 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'bb86dab5-8d6b-4d24-969a-687c2224d48d'} May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:36:04.123351 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. May 16 17:36:04.124761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:36:04.126068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] Returning 404 to user: Instance bb86dab5-8d6b-4d24-969a-687c2224d48d could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:36:04.126068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-3208816b-c4de-4985-96ab-92094eb4e666 tempest-AttachVolumeTestJSON-1930646859 tempest-AttachVolumeTestJSON-1930646859-project] 10.222.0.70 "GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d" status: 404 len: 111 microversion: 2.1 time: 0.030944 May 16 17:36:04.126068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1662/3107] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:36:04 2022] GET /compute/v2.1/servers/bb86dab5-8d6b-4d24-969a-687c2224d48d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:36:09.665877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-f7dae0ab-fe7d-45d7-8cdf-e38cc0dcaf71 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feace29d670>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:09.712402 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-f7dae0ab-fe7d-45d7-8cdf-e38cc0dcaf71 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e78446fc-8144-4782-b6bf-f7c23b0dc798" status: 200 len: 351 microversion: 2.1 time: 0.050918 May 16 17:36:09.712981 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1446/3108] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 17:36:09 2022] GET /compute/v2.1/os-volumes/e78446fc-8144-4782-b6bf-f7c23b0dc798 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:11.034900 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c782c0d4-110f-4d70-983c-8b36802fdb62 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7fead324fdc0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:11.081875 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c782c0d4-110f-4d70-983c-8b36802fdb62 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cca6a884-9e82-4921-b824-91911a2786f2" status: 200 len: 351 microversion: 2.1 time: 0.050622 May 16 17:36:11.082449 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1663/3109] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 17:36:11 2022] GET /compute/v2.1/os-volumes/cca6a884-9e82-4921-b824-91911a2786f2 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:12.407174 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-597eac50-6029-4df5-9ee2-0759a0e8486f tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feace426310>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:12.454443 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-597eac50-6029-4df5-9ee2-0759a0e8486f tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/abd3afef-8718-4603-945c-a7a7b148f983" status: 200 len: 350 microversion: 2.1 time: 0.051449 May 16 17:36:12.455056 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1447/3110] 10.222.0.70 () {58 vars in 1244 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes/abd3afef-8718-4603-945c-a7a7b148f983 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:36:12.472275 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-ec9dde0c-112f-4918-844d-2bb236c296bd tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feacdd1a550>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:12.553954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-ec9dde0c-112f-4918-844d-2bb236c296bd tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090801 May 16 17:36:12.554528 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1664/3111] 10.222.0.70 () {58 vars in 1133 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:36:12.566928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-505bf36c-00ea-4d22-9ea2-611b49518a23 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feace407a60>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:12.647629 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-505bf36c-00ea-4d22-9ea2-611b49518a23 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084471 May 16 17:36:12.648202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1448/3112] 10.222.0.70 () {58 vars in 1148 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:12.659729 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-a48e6060-4aee-46b2-b53d-30ca9da397c1 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feacdad8b80>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:12.738845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-a48e6060-4aee-46b2-b53d-30ca9da397c1 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082773 May 16 17:36:12.739462 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1665/3113] 10.222.0.70 () {58 vars in 1133 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:36:12.750562 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-707d9835-f194-4828-abc2-ec9e70c25d9a tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feacee94dc0>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:12.829416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-707d9835-f194-4828-abc2-ec9e70c25d9a tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082608 May 16 17:36:12.830026 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1449/3114] 10.222.0.70 () {58 vars in 1166 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:12.842016 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e0d4d75c-e1ab-476c-ba27-53b78e9b9aa3 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7fead324fee0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:12.920871 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e0d4d75c-e1ab-476c-ba27-53b78e9b9aa3 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082497 May 16 17:36:12.921445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1666/3115] 10.222.0.70 () {58 vars in 1169 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:12.933022 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-896eb318-dbb1-4673-a810-73621d0f4254 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7fead33d0790>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:13.011730 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-896eb318-dbb1-4673-a810-73621d0f4254 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082337 May 16 17:36:13.012389 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1450/3116] 10.222.0.70 () {58 vars in 1154 bytes} [Mon May 16 17:36:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:36:13.023801 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-c8892b3a-ae5c-4252-a9a4-d452a51e16d6 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feacd94fca0>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:13.105354 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-c8892b3a-ae5c-4252-a9a4-d452a51e16d6 tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085718 May 16 17:36:13.105963 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1667/3117] 10.222.0.70 () {58 vars in 1187 bytes} [Mon May 16 17:36:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:36:13.117850 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-617f5ac6-9f6a-46ed-9c7c-c8867e3949dd tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] Calling method '.version_select at 0x7feace4171f0>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:36:13.198789 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-617f5ac6-9f6a-46ed-9c7c-c8867e3949dd tempest-VolumesTestJSON-757421235 tempest-VolumesTestJSON-757421235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085269 May 16 17:36:13.199362 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1451/3118] 10.222.0.70 () {58 vars in 1154 bytes} [Mon May 16 17:36:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:39.415745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1166567211", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1654863699", "security_groups": [{"name": "tempest-secgroup-smoke-1420321525"}], "block_device_mapping_v2": [{"uuid": "8e599ce9-34d0-434b-9079-98dd883d0131", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad3ce516-d5b8-462f-89a5-dee1c898f741"}]}} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:37:39.524166 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.network.neutron [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] validate_networks() for [('ad3ce516-d5b8-462f-89a5-dee1c898f741', None, None, None, None, None)] {{(pid=117184) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:37:39.907055 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Flavor limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:37:39.907482 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Image limits 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:37:39.907952 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Flavor pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:37:39.908899 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Image pref 0:0:0 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:37:39.909305 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.virt.hardware [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:37:39.917887 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:39.918333 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:39.919128 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:39.919564 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:39.936182 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for project 56b80ff77ba34997843a869bd2707989. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:37:39.940027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.quota [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Getting quotas for user a2a9871c81d649a897166091dd1d4af8 and project 56b80ff77ba34997843a869bd2707989. Resources: {'instances', 'ram', 'cores'} {{(pid=117184) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:37:39.995723 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Going to run 1 instances... {{(pid=117184) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:37:39.997841 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e599ce9-34d0-434b-9079-98dd883d0131',volume_size=None,volume_type=None)] {{(pid=117184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:37:40.132856 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-31182548-710d-4974-af3b-c08817e89206 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722831 May 16 17:37:40.133505 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1668/3119] 10.222.0.70 () {60 vars in 1146 bytes} [Mon May 16 17:37:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:37:40.144544 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-35a74947-7ee6-498e-8b6f-cb2fdf9c6d44 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:40.145147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-35a74947-7ee6-498e-8b6f-cb2fdf9c6d44 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:40.204713 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-35a74947-7ee6-498e-8b6f-cb2fdf9c6d44 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:40.218691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-35a74947-7ee6-498e-8b6f-cb2fdf9c6d44 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1095 microversion: 2.1 time: 0.078844 May 16 17:37:40.219664 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1452/3120] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:40 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:41.236840 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:41.237485 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:41.247793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:41.248250 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:41.249027 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:41.249481 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:41.322108 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:41.329397 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-054ecb07-d0e5-4e04-8597-2abfaf9c78c1 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1211 microversion: 2.1 time: 0.096916 May 16 17:37:41.330005 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1669/3121] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:41 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:42.347396 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:42.348007 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:42.354819 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:42.355311 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:42.356071 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:42.356510 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:42.497406 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:42.506109 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-c8368286-3dd1-495a-89ff-a906c324a73d tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.162956 May 16 17:37:42.507319 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1453/3122] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:42 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:42.787112 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-a394d21c-541e-44e1-9210-6012cbc39fab req-f864b184-b728-4456-8b87-a71b084c41e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef61ee4f-fd54-44b3-90ea-e65ae44438ad", "tag": "c8379287-b344-4cb2-a5c6-94137da3f9a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:37:42.795523 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a394d21c-541e-44e1-9210-6012cbc39fab req-f864b184-b728-4456-8b87-a71b084c41e4 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:42.796203 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-a394d21c-541e-44e1-9210-6012cbc39fab req-f864b184-b728-4456-8b87-a71b084c41e4 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:42.808438 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-a394d21c-541e-44e1-9210-6012cbc39fab req-f864b184-b728-4456-8b87-a71b084c41e4 service nova] Creating event network-changed:c8379287-b344-4cb2-a5c6-94137da3f9a6 for instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad on hv-cinder-83998 May 16 17:37:42.814479 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-a394d21c-541e-44e1-9210-6012cbc39fab req-f864b184-b728-4456-8b87-a71b084c41e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201441 May 16 17:37:42.816092 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1670/3123] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:37:43.523536 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:43.524188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:43.530611 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:43.531066 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:43.532025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:43.532471 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:43.671367 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:43.679561 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4fd4dea5-d9f9-4102-a9e6-86b90e3f6197 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.159883 May 16 17:37:43.680142 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1454/3124] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:43 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:44.697603 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:44.698245 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:44.704347 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:44.704793 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:44.706137 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:44.706570 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:44.835604 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:44.842845 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-37a7c551-9f81-4bed-986c-aa4ec40c1efa tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.150038 May 16 17:37:44.843407 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1671/3125] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:44 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:45.859369 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:45.860010 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:45.866038 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:45.866484 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:45.867266 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:45.867696 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:45.998958 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:46.006776 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-8464b0d6-f5fc-47e0-b102-b53edbb7c6a0 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.151416 May 16 17:37:46.007352 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1455/3126] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:45 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:47.023894 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:47.024520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:47.030798 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:47.031247 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:47.032006 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:47.032442 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:47.162010 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:47.169199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e6a08ee8-ec17-4d71-b99c-376d9e6ab0d5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.149182 May 16 17:37:47.169788 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1672/3127] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:47 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:48.185729 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:48.186376 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:48.196320 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:48.196803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:48.197710 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:48.198197 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:48.329524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:48.338366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-6876f023-3f98-462a-925c-a930e0ab81c9 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.156632 May 16 17:37:48.338940 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1456/3128] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:48 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:49.355012 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:49.355647 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:49.362670 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:49.363118 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:49.363877 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:49.364448 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:49.491707 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:49.498812 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-988128dd-6c58-4e92-912c-7431466aadf3 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.147691 May 16 17:37:49.499372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1673/3129] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:49 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:50.516108 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:50.516718 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:50.523716 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:50.524166 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:50.524928 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:50.525371 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:50.655939 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:50.663551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-7b538106-9d5d-4452-9e5b-81856d7043b5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.151403 May 16 17:37:50.664221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1457/3130] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:50 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:51.680306 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:51.680917 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:51.688148 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:51.688594 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:51.689362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:51.689816 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:51.834249 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:51.841627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-b8aac34d-d953-4036-9bf3-c8396b17715f tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.165165 May 16 17:37:51.842230 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1674/3131] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:51 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:52.859273 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:52.859884 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:52.866644 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:52.867093 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:52.867854 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:52.868285 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:52.996438 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:53.003756 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-e1917c64-aff6-445a-ae3c-48411ee661e7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.148329 May 16 17:37:53.004326 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1458/3132] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:52 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:53.687267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-2fe11fcd-1e0e-47e5-b4a6-85b986001205 req-affb7476-fe2a-4c18-a11e-07bd5b314cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef61ee4f-fd54-44b3-90ea-e65ae44438ad", "name": "network-vif-plugged", "status": "completed", "tag": "c8379287-b344-4cb2-a5c6-94137da3f9a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:37:53.697434 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-2fe11fcd-1e0e-47e5-b4a6-85b986001205 req-affb7476-fe2a-4c18-a11e-07bd5b314cb3 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:53.697925 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-2fe11fcd-1e0e-47e5-b4a6-85b986001205 req-affb7476-fe2a-4c18-a11e-07bd5b314cb3 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:53.709958 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-2fe11fcd-1e0e-47e5-b4a6-85b986001205 req-affb7476-fe2a-4c18-a11e-07bd5b314cb3 service nova] Creating event network-vif-plugged:c8379287-b344-4cb2-a5c6-94137da3f9a6 for instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad on hv-cinder-83998 May 16 17:37:53.715045 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-2fe11fcd-1e0e-47e5-b4a6-85b986001205 req-affb7476-fe2a-4c18-a11e-07bd5b314cb3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031441 May 16 17:37:53.715928 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1675/3133] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:37:54.020777 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:54.021384 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:54.027803 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:54.028254 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:54.029051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:54.029489 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:54.160769 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:54.168059 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-26c99003-d5a1-48cf-a089-1d01b6438fa5 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1267 microversion: 2.1 time: 0.151689 May 16 17:37:54.168634 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1459/3134] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:54 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:55.184417 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:55.185104 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:55.192702 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:55.193146 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:55.193929 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:55.194362 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:55.329150 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:55.336641 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-60dbba86-10f9-4db9-aad0-346eddf59975 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1454 microversion: 2.1 time: 0.156380 May 16 17:37:55.337208 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1676/3135] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:55 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:55.352391 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:55.353003 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:37:55.359380 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:55.359831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:55.360593 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:55.361025 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:55.498983 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:37:55.507101 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1607fcb9-4a82-4f86-9a6d-144fa8e10703 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1454 microversion: 2.1 time: 0.158600 May 16 17:37:55.507672 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1460/3136] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:37:55 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:57.431466 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-b4dabe83-ad0f-42c4-b61b-4dac3f9d20a1 req-8ef89d63-26b1-422e-9f11-eda39fbaa069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef61ee4f-fd54-44b3-90ea-e65ae44438ad", "tag": "c8379287-b344-4cb2-a5c6-94137da3f9a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:37:57.439651 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b4dabe83-ad0f-42c4-b61b-4dac3f9d20a1 req-8ef89d63-26b1-422e-9f11-eda39fbaa069 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:57.441191 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b4dabe83-ad0f-42c4-b61b-4dac3f9d20a1 req-8ef89d63-26b1-422e-9f11-eda39fbaa069 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:57.452558 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-b4dabe83-ad0f-42c4-b61b-4dac3f9d20a1 req-8ef89d63-26b1-422e-9f11-eda39fbaa069 service nova] Creating event network-changed:c8379287-b344-4cb2-a5c6-94137da3f9a6 for instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad on hv-cinder-83998 May 16 17:37:57.457599 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-b4dabe83-ad0f-42c4-b61b-4dac3f9d20a1 req-8ef89d63-26b1-422e-9f11-eda39fbaa069 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029748 May 16 17:37:57.458235 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1677/3137] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:38:18.591735 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:38:18.592323 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:38:25.429800 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:38:25.430295 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:38:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:38:26.892525 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:38:26.892987 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:38:49.219861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:38:49.220741 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:38:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:39:25.263412 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:25.264907 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:25.272957 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:25.273416 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:25.274234 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:25.274877 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:25.302470 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:39:25.329565 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-b173ddcc-327d-4bd0-859e-108d012b0178 req-8230b3de-010b-4e60-bf02-117e7689b25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef61ee4f-fd54-44b3-90ea-e65ae44438ad", "tag": "c8379287-b344-4cb2-a5c6-94137da3f9a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:25.337676 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b173ddcc-327d-4bd0-859e-108d012b0178 req-8230b3de-010b-4e60-bf02-117e7689b25a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:25.338143 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-b173ddcc-327d-4bd0-859e-108d012b0178 req-8230b3de-010b-4e60-bf02-117e7689b25a service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:25.350243 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-b173ddcc-327d-4bd0-859e-108d012b0178 req-8230b3de-010b-4e60-bf02-117e7689b25a service nova] Creating event network-changed:c8379287-b344-4cb2-a5c6-94137da3f9a6 for instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad on hv-cinder-83998 May 16 17:39:25.355873 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-b173ddcc-327d-4bd0-859e-108d012b0178 req-8230b3de-010b-4e60-bf02-117e7689b25a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093739 May 16 17:39:25.356478 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1678/3138] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:39:25.390799 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-1a6bb606-991f-4b6a-814f-2ee8ba73f406 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 204 len: 0 microversion: 2.1 time: 0.131447 May 16 17:39:25.391955 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1461/3139] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:39:25 2022] DELETE /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:39:25.403029 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:25.404047 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:25.418906 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:25.419392 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:25.420171 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:25.420609 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:25.617872 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:39:25.625383 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-e69fd785-d2d1-4aa5-b40d-52d46ef443cc tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1579 microversion: 2.1 time: 0.228719 May 16 17:39:25.626022 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1679/3140] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:25 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1579 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:39:26.643332 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:26.643951 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:26.650555 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:26.651008 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:26.651771 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:26.652202 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:26.843105 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:39:26.851681 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-dbc0a505-6ad1-4a3f-9183-88ce6d0ecaa7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1579 microversion: 2.1 time: 0.212559 May 16 17:39:26.852265 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1462/3141] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:26 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:39:27.640321 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-42480247-8cf9-4014-bec6-9bf4d9d84ad5 req-e169504c-d997-4577-9acd-98e1a64d03a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef61ee4f-fd54-44b3-90ea-e65ae44438ad", "name": "network-vif-deleted", "tag": "c8379287-b344-4cb2-a5c6-94137da3f9a6"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:27.652199 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-42480247-8cf9-4014-bec6-9bf4d9d84ad5 req-e169504c-d997-4577-9acd-98e1a64d03a7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:27.652730 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-42480247-8cf9-4014-bec6-9bf4d9d84ad5 req-e169504c-d997-4577-9acd-98e1a64d03a7 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:27.671084 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-42480247-8cf9-4014-bec6-9bf4d9d84ad5 req-e169504c-d997-4577-9acd-98e1a64d03a7 service nova] Creating event network-vif-deleted:c8379287-b344-4cb2-a5c6-94137da3f9a6 for instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad on hv-cinder-83998 May 16 17:39:27.679994 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-42480247-8cf9-4014-bec6-9bf4d9d84ad5 req-e169504c-d997-4577-9acd-98e1a64d03a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043251 May 16 17:39:27.681160 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1680/3142] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:27.869962 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:27.870481 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:27.877770 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:27.878188 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:27.878985 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:27.879427 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:27.951138 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:39:27.958831 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-adf72d7a-91ce-46b9-96d3-e805dae8ec89 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 200 len: 1226 microversion: 2.1 time: 0.092807 May 16 17:39:27.959405 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1463/3143] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:27 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:39:28.977267 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:28.977993 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: ef61ee4f-fd54-44b3-90ea-e65ae44438ad] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:28.984068 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:28.984520 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:28.985372 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:28.985761 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:28.999568 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] HTTP exception thrown: Instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad could not be found. May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Request method failure captured: May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad HTTP/1.1 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigorJzftzXvjSlZjyA9Bc1D8i7pEO0qjBDlX2OgTNAmgEON0JK2waPtOuLw0itM_pJmw4SvqOrLvDk5j1VDbfT4rwA-dTzyU6VqVAxWppG8auGSxpFZ9Ff0RvEVjHMzL0VIaaGmOH95fMnWHd4744TE2E7mDpGviY4G3m8k4zNkgwV74 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:39:29.001210 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56b80ff77ba34997843a869bd2707989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56b80ff77ba34997843a869bd2707989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-TestVolumeBootPattern-771000302 May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: a2a9871c81d649a897166091dd1d4af8 May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad could not be found. May 16 17:39:29.002445 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': 'ef61ee4f-fd54-44b3-90ea-e65ae44438ad'} May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad could not be found. May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:29.003076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad could not be found. May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad could not be found. May 16 17:39:29.004745 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:29.005954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Returning 404 to user: Instance ef61ee4f-fd54-44b3-90ea-e65ae44438ad could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:29.005954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-05855b2d-4853-4a21-9007-fb8ce1feed9c tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad" status: 404 len: 111 microversion: 2.1 time: 0.029975 May 16 17:39:29.005954 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1681/3144] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:28 2022] GET /compute/v2.1/servers/ef61ee4f-fd54-44b3-90ea-e65ae44438ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:32.034904 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:32.035418 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:32.036623 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-3b0c3ffe-70b5-4743-9b79-f4396722be7e req-f55cc20a-40d6-419a-b18d-86694026e07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bc744d-e476-4d5f-8268-d08f077cba52", "tag": "c363d6a4-6a17-4ebb-9aa7-2390652e120d"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:32.041971 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:32.042657 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:32.043505 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:32.044154 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:32.045608 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-3b0c3ffe-70b5-4743-9b79-f4396722be7e req-f55cc20a-40d6-419a-b18d-86694026e07f service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:32.046076 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-3b0c3ffe-70b5-4743-9b79-f4396722be7e req-f55cc20a-40d6-419a-b18d-86694026e07f service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:32.061671 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-3b0c3ffe-70b5-4743-9b79-f4396722be7e req-f55cc20a-40d6-419a-b18d-86694026e07f service nova] Creating event network-changed:c363d6a4-6a17-4ebb-9aa7-2390652e120d for instance 78bc744d-e476-4d5f-8268-d08f077cba52 on hv-cinder-83998 May 16 17:39:32.068002 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-3b0c3ffe-70b5-4743-9b79-f4396722be7e req-f55cc20a-40d6-419a-b18d-86694026e07f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036192 May 16 17:39:32.068814 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1682/3145] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:39:32.071579 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Going to try to terminate instance {{(pid=117183) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:39:32.160953 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-4ac3fb4a-03fe-49e8-b115-ea3819fa7ce6 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 204 len: 0 microversion: 2.1 time: 0.131011 May 16 17:39:32.161861 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1464/3146] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:39:32 2022] DELETE /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:39:32.170696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:32.171497 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:32.178317 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:32.178769 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:32.179541 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:32.179978 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:32.321184 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.policy [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117184) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:39:32.328960 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-6a79fe6b-fd03-45ac-9298-ef406b6f6e94 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1580 microversion: 2.1 time: 0.162361 May 16 17:39:32.329543 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1683/3147] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:32 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:39:33.348051 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:33.348759 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:33.355067 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:33.355524 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:33.356304 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:33.356750 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:33.583628 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:39:33.590976 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-58b50877-6e25-4368-9564-5c7264c0fc50 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1580 microversion: 2.1 time: 0.247686 May 16 17:39:33.591551 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1465/3148] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:33 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1580 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:39:34.224601 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [req-035f4328-ebfc-4d97-8170-5f8776ceec72 req-c712cb18-a237-44d0-bef2-88702bc2c3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bc744d-e476-4d5f-8268-d08f077cba52", "name": "network-vif-deleted", "tag": "c363d6a4-6a17-4ebb-9aa7-2390652e120d"}]} {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:34.234386 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-035f4328-ebfc-4d97-8170-5f8776ceec72 req-c712cb18-a237-44d0-bef2-88702bc2c3e5 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:34.235030 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [req-035f4328-ebfc-4d97-8170-5f8776ceec72 req-c712cb18-a237-44d0-bef2-88702bc2c3e5 service nova] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:34.248311 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.compute.server_external_events [req-035f4328-ebfc-4d97-8170-5f8776ceec72 req-c712cb18-a237-44d0-bef2-88702bc2c3e5 service nova] Creating event network-vif-deleted:c363d6a4-6a17-4ebb-9aa7-2390652e120d for instance 78bc744d-e476-4d5f-8268-d08f077cba52 on hv-cinder-83998 May 16 17:39:34.254011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [req-035f4328-ebfc-4d97-8170-5f8776ceec72 req-c712cb18-a237-44d0-bef2-88702bc2c3e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033448 May 16 17:39:34.255078 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1684/3149] 10.222.0.70 () {64 vars in 1317 bytes} [Mon May 16 17:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:34.608346 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:34.609020 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:34.616762 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:34.617553 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:34.618444 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:34.619046 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:34.660233 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:34.660691 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:34.661147 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.objects.instance [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lazy-loading 'fault' on Instance uuid 78bc744d-e476-4d5f-8268-d08f077cba52 {{(pid=117183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:39:34.701221 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.policy [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a9871c81d649a897166091dd1d4af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b80ff77ba34997843a869bd2707989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117183) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:39:34.709106 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-b0f0e8be-0286-4f48-90a6-e6e2c7a82861 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 200 len: 1231 microversion: 2.1 time: 0.105139 May 16 17:39:34.709686 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1466/3150] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:34 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:39:35.727090 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:35.727734 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 78bc744d-e476-4d5f-8268-d08f077cba52] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:35.734066 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:35.734514 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:35.735266 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:35.735696 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:35.749011 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] HTTP exception thrown: Instance 78bc744d-e476-4d5f-8268-d08f077cba52 could not be found. May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Request method failure captured: May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 HTTP/1.1 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigorJzftzXvjSlZjyA9Bc1D8i7pEO0qjBDlX2OgTNAmgEON0JK2waPtOuLw0itM_pJmw4SvqOrLvDk5j1VDbfT4rwA-dTzyU6VqVAxWppG8auGSxpFZ9Ff0RvEVjHMzL0VIaaGmOH95fMnWHd4744TE2E7mDpGviY4G3m8k4zNkgwV74 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:39:35.750627 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56b80ff77ba34997843a869bd2707989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56b80ff77ba34997843a869bd2707989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-TestVolumeBootPattern-771000302 May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: a2a9871c81d649a897166091dd1d4af8 May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 78bc744d-e476-4d5f-8268-d08f077cba52 could not be found. May 16 17:39:35.751923 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '78bc744d-e476-4d5f-8268-d08f077cba52'} May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bc744d-e476-4d5f-8268-d08f077cba52 could not be found. May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:35.752748 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bc744d-e476-4d5f-8268-d08f077cba52 could not be found. May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bc744d-e476-4d5f-8268-d08f077cba52 could not be found. May 16 17:39:35.754193 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:35.755270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Returning 404 to user: Instance 78bc744d-e476-4d5f-8268-d08f077cba52 could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:35.755270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-fc57ff6f-c772-44a5-93d5-8aa5c6904701 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52" status: 404 len: 111 microversion: 2.1 time: 0.030236 May 16 17:39:35.755270 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1685/3151] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:35 2022] GET /compute/v2.1/servers/78bc744d-e476-4d5f-8268-d08f077cba52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:36.470242 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:36.473780 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.compute.api [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117183) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:36.479824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:36.480278 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:36.481061 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:36.481496 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG oslo_concurrency.lockutils [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:36.496588 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.wsgi [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] HTTP exception thrown: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Request method failure captured: May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: request: DELETE /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f HTTP/1.1 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept: application/json May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Accept-Encoding: identity May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Connection: close May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Length: 0 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Content-Type: application/json May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Host: 10.222.0.70 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Openstack-System-Scope: None May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: User-Agent: python-urllib3/1.26.9 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Auth-Token: gAAAAABigorJzftzXvjSlZjyA9Bc1D8i7pEO0qjBDlX2OgTNAmgEON0JK2waPtOuLw0itM_pJmw4SvqOrLvDk5j1VDbfT4rwA-dTzyU6VqVAxWppG8auGSxpFZ9Ff0RvEVjHMzL0VIaaGmOH95fMnWHd4744TE2E7mDpGviY4G3m8k4zNkgwV74 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Id: None May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Domain-Name: None May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Identity-Status: Confirmed May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Is-Admin-Project: True May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Id: default May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Domain-Name: Default May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Project-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Role: reader,member May 16 17:39:36.498340 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Roles: reader,member May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56b80ff77ba34997843a869bd2707989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56b80ff77ba34997843a869bd2707989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant: tempest-TestVolumeBootPattern-771000302 May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-Tenant-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Id: default May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Domain-Name: Default May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Id: a2a9871c81d649a897166091dd1d4af8 May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: X-User-Name: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: method: > May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: exception: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.499656 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: action_args: {'id': '29847fc0-9183-4628-94f2-e358c014855f'} May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:36.500393 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.501824 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: ERROR nova.api.openstack.wsgi May 16 17:39:36.503085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Returning 404 to user: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. {{(pid=117183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:36.503085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-08d86e0c-edbe-4f09-94f1-0fb171604556 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 404 len: 111 microversion: 2.1 time: 0.033492 May 16 17:39:36.503085 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1467/3152] 10.222.0.70 () {58 vars in 1238 bytes} [Mon May 16 17:39:36 2022] DELETE /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:36.510139 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '>' {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:36.510758 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.compute.api [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] [instance: 29847fc0-9183-4628-94f2-e358c014855f] Fetching instance by UUID {{(pid=117184) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:39:36.516657 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:36.517111 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:36.517909 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:36.518349 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG oslo_concurrency.lockutils [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Lock "316a0b18-3be7-4e60-8d08-0592b3fea63b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:36.533344 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.wsgi [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] HTTP exception thrown: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Request method failure captured: May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: request: GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f HTTP/1.1 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept: application/json May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Accept-Encoding: identity May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Connection: close May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Length: 0 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Content-Type: application/json May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Host: 10.222.0.70 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Openstack-System-Scope: None May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: User-Agent: python-urllib3/1.26.9 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Auth-Token: gAAAAABigorJzftzXvjSlZjyA9Bc1D8i7pEO0qjBDlX2OgTNAmgEON0JK2waPtOuLw0itM_pJmw4SvqOrLvDk5j1VDbfT4rwA-dTzyU6VqVAxWppG8auGSxpFZ9Ff0RvEVjHMzL0VIaaGmOH95fMnWHd4744TE2E7mDpGviY4G3m8k4zNkgwV74 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Id: None May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Domain-Name: None May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Identity-Status: Confirmed May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Is-Admin-Project: True May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Id: default May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Domain-Name: Default May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Project-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Role: reader,member May 16 17:39:36.535496 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Roles: reader,member May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56b80ff77ba34997843a869bd2707989"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56b80ff77ba34997843a869bd2707989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56b80ff77ba34997843a869bd2707989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}] May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant: tempest-TestVolumeBootPattern-771000302 May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Id: 56b80ff77ba34997843a869bd2707989 May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-Tenant-Name: tempest-TestVolumeBootPattern-771000302 May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Id: default May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Domain-Name: Default May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Id: a2a9871c81d649a897166091dd1d4af8 May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: X-User-Name: tempest-TestVolumeBootPattern-771000302-project May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: method: > May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: exception: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.536634 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: action_args: {'id': '29847fc0-9183-4628-94f2-e358c014855f'} May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: {{(pid=117184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:36.537224 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. May 16 17:39:36.538334 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: ERROR nova.api.openstack.wsgi May 16 17:39:36.539411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: DEBUG nova.api.openstack.wsgi [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Returning 404 to user: Instance 29847fc0-9183-4628-94f2-e358c014855f could not be found. {{(pid=117184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:36.539411 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO nova.api.openstack.requestlog [None req-528070aa-bd32-4099-957e-134770bce6d7 tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f" status: 404 len: 111 microversion: 2.1 time: 0.030586 May 16 17:39:36.539731 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: [pid: 117184|app: 0|req: 1686/3153] 10.222.0.70 () {58 vars in 1235 bytes} [Mon May 16 17:39:36 2022] GET /compute/v2.1/servers/29847fc0-9183-4628-94f2-e358c014855f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:37.820382 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: DEBUG nova.api.openstack.wsgi [None req-de84ae3d-bb48-4b95-b1ff-91c245bbca7e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] Calling method '.version_select at 0x7feace407f70>' {{(pid=117183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:37.857366 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO nova.api.openstack.requestlog [None req-de84ae3d-bb48-4b95-b1ff-91c245bbca7e tempest-TestVolumeBootPattern-771000302 tempest-TestVolumeBootPattern-771000302-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1654863699" status: 202 len: 0 microversion: 2.1 time: 0.041499 May 16 17:39:37.858549 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: [pid: 117183|app: 0|req: 1468/3154] 10.222.0.70 () {58 vars in 1262 bytes} [Mon May 16 17:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1654863699 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:40:22.509679 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:40:22.510326 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:40:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:41:38.601210 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:41:38.601900 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:41:45.437489 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:41:45.438018 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:41:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:42:09.228458 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:42:09.229130 dv-cinder-839987-4-iscsi devstack@n-api.service[117183]: Mon May 16 17:42:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:43:42.517519 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:43:42.518157 dv-cinder-839987-4-iscsi devstack@n-api.service[117184]: Mon May 16 17:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!